2023-11-01 09:53:46,763 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-01 09:53:47,002 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f 2023-11-01 09:53:47,015 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-01 09:53:47,016 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e, deleteOnExit=true 2023-11-01 09:53:47,016 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-01 09:53:47,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/test.cache.data in system properties and HBase conf 2023-11-01 09:53:47,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/hadoop.tmp.dir in system properties and HBase conf 2023-11-01 09:53:47,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/hadoop.log.dir in system properties and HBase conf 2023-11-01 09:53:47,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-01 09:53:47,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-01 09:53:47,019 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-01 09:53:47,135 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-01 09:53:47,535 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-01 09:53:47,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-01 09:53:47,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-01 09:53:47,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-01 09:53:47,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-01 09:53:47,543 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-01 09:53:47,543 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-01 09:53:47,544 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-01 09:53:47,544 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-01 09:53:47,545 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-01 09:53:47,545 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/nfs.dump.dir in system properties and HBase conf 2023-11-01 09:53:47,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/java.io.tmpdir in system properties and HBase conf 2023-11-01 09:53:47,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-01 09:53:47,546 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-01 09:53:47,547 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-01 09:53:48,217 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-01 09:53:48,222 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-01 09:53:48,505 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-01 09:53:48,673 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-01 09:53:48,693 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-01 09:53:48,735 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-01 09:53:48,768 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/java.io.tmpdir/Jetty_localhost_38417_hdfs____j8p3en/webapp 2023-11-01 09:53:48,902 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38417 2023-11-01 09:53:48,913 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-01 09:53:48,914 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-01 09:53:49,446 WARN [Listener at localhost/43023] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-01 09:53:49,530 WARN [Listener at localhost/43023] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-01 09:53:49,553 WARN [Listener at localhost/43023] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-01 09:53:49,560 INFO [Listener at localhost/43023] log.Slf4jLog(67): jetty-6.1.26 2023-11-01 09:53:49,572 INFO [Listener at localhost/43023] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/java.io.tmpdir/Jetty_localhost_37589_datanode____gscs1l/webapp 2023-11-01 09:53:49,703 INFO [Listener at localhost/43023] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37589 2023-11-01 09:53:50,075 WARN [Listener at localhost/37085] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-01 09:53:50,591 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x285914fa34f8cd44: Processing first storage report for DS-95e4159e-826c-4234-bc1d-43be08563c4d from datanode 4ad3621f-380f-4aed-bfb9-74cd49256923 2023-11-01 09:53:50,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x285914fa34f8cd44: from storage DS-95e4159e-826c-4234-bc1d-43be08563c4d node DatanodeRegistration(127.0.0.1:44993, datanodeUuid=4ad3621f-380f-4aed-bfb9-74cd49256923, infoPort=43041, infoSecurePort=0, ipcPort=37085, storageInfo=lv=-57;cid=testClusterID;nsid=2090193497;c=1698832428297), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-01 09:53:50,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x285914fa34f8cd44: Processing first storage report for DS-40eadba4-0f50-4bef-98ae-3a59a2575aa0 from datanode 4ad3621f-380f-4aed-bfb9-74cd49256923 2023-11-01 09:53:50,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x285914fa34f8cd44: from storage DS-40eadba4-0f50-4bef-98ae-3a59a2575aa0 node DatanodeRegistration(127.0.0.1:44993, datanodeUuid=4ad3621f-380f-4aed-bfb9-74cd49256923, infoPort=43041, infoSecurePort=0, ipcPort=37085, storageInfo=lv=-57;cid=testClusterID;nsid=2090193497;c=1698832428297), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-01 09:53:50,610 DEBUG [Listener at localhost/37085] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f 2023-11-01 09:53:50,682 INFO [Listener at localhost/37085] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/zookeeper_0, clientPort=49762, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-11-01 09:53:50,697 INFO [Listener at localhost/37085] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49762 2023-11-01 09:53:50,707 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:50,709 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:51,406 INFO [Listener at localhost/37085] util.FSUtils(471): Created version file at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659 with version=8 2023-11-01 09:53:51,406 INFO [Listener at localhost/37085] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/hbase-staging 2023-11-01 09:53:51,743 INFO [Listener at localhost/37085] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-01 09:53:52,252 INFO [Listener at localhost/37085] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-01 09:53:52,284 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-01 09:53:52,285 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-01 09:53:52,285 INFO [Listener at localhost/37085] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-01 09:53:52,285 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-01 09:53:52,285 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-01 09:53:52,428 INFO [Listener at localhost/37085] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-01 09:53:52,513 DEBUG [Listener at localhost/37085] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-01 09:53:52,607 INFO [Listener at localhost/37085] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41153 2023-11-01 09:53:52,618 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:52,620 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:52,643 INFO [Listener at localhost/37085] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41153 connecting to ZooKeeper ensemble=127.0.0.1:49762 2023-11-01 09:53:52,681 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:411530x0, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-01 09:53:52,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41153-0x101a10cedf10000 connected 2023-11-01 09:53:52,715 DEBUG [Listener at localhost/37085] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-01 09:53:52,715 DEBUG [Listener at localhost/37085] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-01 09:53:52,718 DEBUG [Listener at localhost/37085] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-01 09:53:52,726 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41153 2023-11-01 09:53:52,726 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41153 2023-11-01 09:53:52,726 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41153 2023-11-01 09:53:52,727 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41153 2023-11-01 09:53:52,729 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41153 2023-11-01 09:53:52,734 INFO [Listener at localhost/37085] master.HMaster(444): hbase.rootdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659, hbase.cluster.distributed=false 2023-11-01 09:53:52,817 INFO [Listener at localhost/37085] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-01 09:53:52,818 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-01 09:53:52,818 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-01 09:53:52,818 INFO [Listener at localhost/37085] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-01 09:53:52,818 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-01 09:53:52,818 INFO [Listener at localhost/37085] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-01 09:53:52,823 INFO [Listener at localhost/37085] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-01 09:53:52,830 INFO [Listener at localhost/37085] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40233 2023-11-01 09:53:52,832 INFO [Listener at localhost/37085] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-01 09:53:52,844 DEBUG [Listener at localhost/37085] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-01 09:53:52,845 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:52,848 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:52,851 INFO [Listener at localhost/37085] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40233 connecting to ZooKeeper ensemble=127.0.0.1:49762 2023-11-01 09:53:52,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:402330x0, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-01 09:53:52,857 DEBUG [Listener at localhost/37085] zookeeper.ZKUtil(164): regionserver:402330x0, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-01 09:53:52,859 DEBUG [Listener at localhost/37085] zookeeper.ZKUtil(164): regionserver:402330x0, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-01 09:53:52,859 DEBUG [Listener at localhost/37085] zookeeper.ZKUtil(164): regionserver:402330x0, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-01 09:53:52,867 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40233 2023-11-01 09:53:52,868 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40233 2023-11-01 09:53:52,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40233-0x101a10cedf10001 connected 2023-11-01 09:53:52,877 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40233 2023-11-01 09:53:52,881 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40233 2023-11-01 09:53:52,882 DEBUG [Listener at localhost/37085] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40233 2023-11-01 09:53:52,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:52,893 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-01 09:53:52,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:52,920 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-01 09:53:52,920 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-01 09:53:52,920 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:52,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-01 09:53:52,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-01 09:53:52,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41153,1698832431566 from backup master directory 2023-11-01 09:53:52,927 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:52,927 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-01 09:53:52,928 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-01 09:53:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:52,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-01 09:53:52,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-01 09:53:53,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/hbase.id with ID: 6ef47146-104d-47d6-82d2-d06428b2176c 2023-11-01 09:53:53,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:53,072 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:53,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6524041a to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:53:53,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64882ccc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:53:53,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-01 09:53:53,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-01 09:53:53,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-01 09:53:53,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-01 09:53:53,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-01 09:53:53,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-01 09:53:53,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-01 09:53:53,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store-tmp 2023-11-01 09:53:53,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:53,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-01 09:53:53,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:53:53,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:53:53,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-01 09:53:53,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:53:53,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:53:53,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-01 09:53:53,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/WALs/jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:53,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41153%2C1698832431566, suffix=, logDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/WALs/jenkins-hbase4.apache.org,41153,1698832431566, archiveDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/oldWALs, maxLogs=10 2023-11-01 09:53:53,355 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44993,DS-95e4159e-826c-4234-bc1d-43be08563c4d,DISK] 2023-11-01 09:53:53,366 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-01 09:53:53,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/WALs/jenkins-hbase4.apache.org,41153,1698832431566/jenkins-hbase4.apache.org%2C41153%2C1698832431566.1698832433291 2023-11-01 09:53:53,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44993,DS-95e4159e-826c-4234-bc1d-43be08563c4d,DISK]] 2023-11-01 09:53:53,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:53:53,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:53,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-01 09:53:53,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-01 09:53:53,514 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-01 09:53:53,521 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-01 09:53:53,547 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-01 09:53:53,560 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:53,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-01 09:53:53,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-01 09:53:53,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-01 09:53:53,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:53:53,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69213095, jitterRate=0.03135548532009125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:53:53,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-01 09:53:53,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-01 09:53:53,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-01 09:53:53,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-01 09:53:53,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-01 09:53:53,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-01 09:53:53,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-11-01 09:53:53,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-01 09:53:53,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-01 09:53:53,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-01 09:53:53,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-01 09:53:53,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-01 09:53:53,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-01 09:53:53,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-01 09:53:53,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-01 09:53:53,741 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:53,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-01 09:53:53,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-01 09:53:53,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-01 09:53:53,761 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-01 09:53:53,762 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-01 09:53:53,762 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:53,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41153,1698832431566, sessionid=0x101a10cedf10000, setting cluster-up flag (Was=false) 2023-11-01 09:53:53,781 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:53,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-01 09:53:53,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:53,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:53,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-01 09:53:53,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:53,807 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp 2023-11-01 09:53:53,890 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(951): ClusterId : 6ef47146-104d-47d6-82d2-d06428b2176c 2023-11-01 09:53:53,896 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-01 09:53:53,902 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-01 09:53:53,902 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-01 09:53:53,913 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-01 09:53:53,915 DEBUG [RS:0;jenkins-hbase4:40233] zookeeper.ReadOnlyZKClient(139): Connect 0x0e7f85d0 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:53:53,921 DEBUG [RS:0;jenkins-hbase4:40233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b87a6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:53:53,922 DEBUG [RS:0;jenkins-hbase4:40233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@487eea0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-01 09:53:53,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-01 09:53:53,950 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40233 2023-11-01 09:53:53,955 INFO [RS:0;jenkins-hbase4:40233] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-01 09:53:53,955 INFO [RS:0;jenkins-hbase4:40233] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-01 09:53:53,955 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1022): About to register with Master. 2023-11-01 09:53:53,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-01 09:53:53,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-01 09:53:53,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-01 09:53:53,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-01 09:53:53,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-01 09:53:53,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:53,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-01 09:53:53,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:53,957 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41153,1698832431566 with isa=jenkins-hbase4.apache.org/172.31.14.131:40233, startcode=1698832432817 2023-11-01 09:53:53,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698832463958 2023-11-01 09:53:53,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-01 09:53:53,965 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-01 09:53:53,966 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-01 09:53:53,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-01 09:53:53,971 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-01 09:53:53,978 DEBUG [RS:0;jenkins-hbase4:40233] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-01 09:53:53,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-01 09:53:53,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-01 09:53:53,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-01 09:53:53,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-01 09:53:53,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:53,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-01 09:53:53,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-01 09:53:53,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-01 09:53:53,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-01 09:53:53,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-01 09:53:53,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698832433990,5,FailOnTimeoutGroup] 2023-11-01 09:53:53,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698832433990,5,FailOnTimeoutGroup] 2023-11-01 09:53:53,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:53,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-01 09:53:53,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:53,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,038 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41915, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-01 09:53:54,051 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41153] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:54,068 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659 2023-11-01 09:53:54,068 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43023 2023-11-01 09:53:54,068 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-01 09:53:54,073 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-01 09:53:54,074 DEBUG [RS:0;jenkins-hbase4:40233] zookeeper.ZKUtil(162): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:54,074 WARN [RS:0;jenkins-hbase4:40233] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-01 09:53:54,075 INFO [RS:0;jenkins-hbase4:40233] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-01 09:53:54,075 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/WALs/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:54,077 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40233,1698832432817] 2023-11-01 09:53:54,084 DEBUG [RS:0;jenkins-hbase4:40233] zookeeper.ZKUtil(162): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:54,095 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-01 09:53:54,104 INFO [RS:0;jenkins-hbase4:40233] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-01 09:53:54,125 INFO [RS:0;jenkins-hbase4:40233] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-01 09:53:54,131 INFO [RS:0;jenkins-hbase4:40233] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:53:54,131 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,133 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-01 09:53:54,142 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,142 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,143 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,143 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,143 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,143 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,143 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-01 09:53:54,144 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,144 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,144 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,144 DEBUG [RS:0;jenkins-hbase4:40233] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-01 09:53:54,146 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,146 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,146 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,163 INFO [RS:0;jenkins-hbase4:40233] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-01 09:53:54,165 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40233,1698832432817-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:54,182 INFO [RS:0;jenkins-hbase4:40233] regionserver.Replication(203): jenkins-hbase4.apache.org,40233,1698832432817 started 2023-11-01 09:53:54,182 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40233,1698832432817, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40233, sessionid=0x101a10cedf10001 2023-11-01 09:53:54,182 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-01 09:53:54,182 DEBUG [RS:0;jenkins-hbase4:40233] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:54,182 DEBUG [RS:0;jenkins-hbase4:40233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40233,1698832432817' 2023-11-01 09:53:54,182 DEBUG [RS:0;jenkins-hbase4:40233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:53:54,183 DEBUG [RS:0;jenkins-hbase4:40233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:53:54,184 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-01 09:53:54,184 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-01 09:53:54,184 DEBUG [RS:0;jenkins-hbase4:40233] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:54,184 DEBUG [RS:0;jenkins-hbase4:40233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40233,1698832432817' 2023-11-01 09:53:54,184 DEBUG [RS:0;jenkins-hbase4:40233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-01 09:53:54,184 DEBUG [RS:0;jenkins-hbase4:40233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-01 09:53:54,185 DEBUG [RS:0;jenkins-hbase4:40233] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-01 09:53:54,185 INFO [RS:0;jenkins-hbase4:40233] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-01 09:53:54,185 INFO [RS:0;jenkins-hbase4:40233] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-01 09:53:54,297 INFO [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40233%2C1698832432817, suffix=, logDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/WALs/jenkins-hbase4.apache.org,40233,1698832432817, archiveDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/oldWALs, maxLogs=32 2023-11-01 09:53:54,315 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44993,DS-95e4159e-826c-4234-bc1d-43be08563c4d,DISK] 2023-11-01 09:53:54,318 INFO [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/WALs/jenkins-hbase4.apache.org,40233,1698832432817/jenkins-hbase4.apache.org%2C40233%2C1698832432817.1698832434299 2023-11-01 09:53:54,319 DEBUG [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44993,DS-95e4159e-826c-4234-bc1d-43be08563c4d,DISK]] 2023-11-01 09:53:54,412 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-01 09:53:54,414 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-01 09:53:54,414 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659 2023-11-01 09:53:54,830 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:54,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-01 09:53:54,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/info 2023-11-01 09:53:54,838 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-01 09:53:54,839 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:54,839 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-01 09:53:54,842 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/rep_barrier 2023-11-01 09:53:54,843 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-01 09:53:54,844 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:54,845 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-01 09:53:54,847 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/table 2023-11-01 09:53:54,848 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-01 09:53:54,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:54,851 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740 2023-11-01 09:53:54,852 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740 2023-11-01 09:53:54,857 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-01 09:53:54,860 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-01 09:53:54,864 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:53:54,865 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65245271, jitterRate=-0.027769699692726135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-01 09:53:54,865 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-01 09:53:54,865 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-01 09:53:54,865 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-01 09:53:54,865 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-01 09:53:54,865 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-01 09:53:54,865 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-01 09:53:54,867 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-01 09:53:54,867 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-01 09:53:54,872 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-01 09:53:54,872 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-01 09:53:54,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-01 09:53:54,897 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-01 09:53:54,900 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-01 09:53:55,052 DEBUG [jenkins-hbase4:41153] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-01 09:53:55,056 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40233,1698832432817, state=OPENING 2023-11-01 09:53:55,065 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-01 09:53:55,066 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:55,067 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-01 09:53:55,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:53:55,256 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:55,258 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-01 09:53:55,262 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-01 09:53:55,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-01 09:53:55,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-01 09:53:55,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40233%2C1698832432817.meta, suffix=.meta, logDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/WALs/jenkins-hbase4.apache.org,40233,1698832432817, archiveDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/oldWALs, maxLogs=32 2023-11-01 09:53:55,292 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44993,DS-95e4159e-826c-4234-bc1d-43be08563c4d,DISK] 2023-11-01 09:53:55,295 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/WALs/jenkins-hbase4.apache.org,40233,1698832432817/jenkins-hbase4.apache.org%2C40233%2C1698832432817.meta.1698832435277.meta 2023-11-01 09:53:55,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44993,DS-95e4159e-826c-4234-bc1d-43be08563c4d,DISK]] 2023-11-01 09:53:55,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:53:55,297 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-01 09:53:55,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-01 09:53:55,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-01 09:53:55,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-01 09:53:55,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:55,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-01 09:53:55,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-01 09:53:55,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-01 09:53:55,329 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/info 2023-11-01 09:53:55,329 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/info 2023-11-01 09:53:55,330 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-01 09:53:55,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:55,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-01 09:53:55,333 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/rep_barrier 2023-11-01 09:53:55,333 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/rep_barrier 2023-11-01 09:53:55,334 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-01 09:53:55,335 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:55,335 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-01 09:53:55,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/table 2023-11-01 09:53:55,336 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/table 2023-11-01 09:53:55,337 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-01 09:53:55,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:55,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740 2023-11-01 09:53:55,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740 2023-11-01 09:53:55,346 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-01 09:53:55,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-01 09:53:55,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73985923, jitterRate=0.10247616469860077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-01 09:53:55,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-01 09:53:55,373 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698832435249 2023-11-01 09:53:55,390 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-01 09:53:55,391 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-01 09:53:55,392 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40233,1698832432817, state=OPEN 2023-11-01 09:53:55,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-01 09:53:55,395 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-01 09:53:55,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-01 09:53:55,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40233,1698832432817 in 325 msec 2023-11-01 09:53:55,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-01 09:53:55,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 520 msec 2023-11-01 09:53:55,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5450 sec 2023-11-01 09:53:55,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698832435412, completionTime=-1 2023-11-01 09:53:55,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-01 09:53:55,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-01 09:53:55,484 DEBUG [hconnection-0x5fd5903c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:53:55,488 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:53:55,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-01 09:53:55,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698832495507 2023-11-01 09:53:55,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698832555508 2023-11-01 09:53:55,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 95 msec 2023-11-01 09:53:55,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41153,1698832431566-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:55,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41153,1698832431566-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:55,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41153,1698832431566-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:55,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41153, period=300000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:55,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-01 09:53:55,545 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-01 09:53:55,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-01 09:53:55,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-01 09:53:55,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-01 09:53:55,571 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:53:55,574 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:53:55,598 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:55,600 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb empty. 2023-11-01 09:53:55,601 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:55,601 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-01 09:53:55,631 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-01 09:53:55,634 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b12ce301cd7fb26d2cfa7146f93bc0fb, NAME => 'hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:53:55,646 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:55,647 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b12ce301cd7fb26d2cfa7146f93bc0fb, disabling compactions & flushes 2023-11-01 09:53:55,647 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:55,647 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:55,647 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. after waiting 0 ms 2023-11-01 09:53:55,647 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:55,647 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:55,647 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b12ce301cd7fb26d2cfa7146f93bc0fb: 2023-11-01 09:53:55,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:53:55,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698832435655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832435655"}]},"ts":"1698832435655"} 2023-11-01 09:53:55,696 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:53:55,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:53:55,704 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832435698"}]},"ts":"1698832435698"} 2023-11-01 09:53:55,708 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-01 09:53:55,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b12ce301cd7fb26d2cfa7146f93bc0fb, ASSIGN}] 2023-11-01 09:53:55,725 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b12ce301cd7fb26d2cfa7146f93bc0fb, ASSIGN 2023-11-01 09:53:55,727 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b12ce301cd7fb26d2cfa7146f93bc0fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:53:55,878 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b12ce301cd7fb26d2cfa7146f93bc0fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:55,879 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698832435878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832435878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832435878"}]},"ts":"1698832435878"} 2023-11-01 09:53:55,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b12ce301cd7fb26d2cfa7146f93bc0fb, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:53:56,039 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:56,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:56,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b12ce301cd7fb26d2cfa7146f93bc0fb, NAME => 'hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:53:56,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:56,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,049 INFO [StoreOpener-b12ce301cd7fb26d2cfa7146f93bc0fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,052 DEBUG [StoreOpener-b12ce301cd7fb26d2cfa7146f93bc0fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/info 2023-11-01 09:53:56,052 DEBUG [StoreOpener-b12ce301cd7fb26d2cfa7146f93bc0fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/info 2023-11-01 09:53:56,052 INFO [StoreOpener-b12ce301cd7fb26d2cfa7146f93bc0fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b12ce301cd7fb26d2cfa7146f93bc0fb columnFamilyName info 2023-11-01 09:53:56,053 INFO [StoreOpener-b12ce301cd7fb26d2cfa7146f93bc0fb-1] regionserver.HStore(310): Store=b12ce301cd7fb26d2cfa7146f93bc0fb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:56,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:53:56,063 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:53:56,064 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b12ce301cd7fb26d2cfa7146f93bc0fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64511200, jitterRate=-0.03870820999145508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:53:56,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b12ce301cd7fb26d2cfa7146f93bc0fb: 2023-11-01 09:53:56,066 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb., pid=6, masterSystemTime=1698832436039 2023-11-01 09:53:56,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:56,070 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:53:56,071 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b12ce301cd7fb26d2cfa7146f93bc0fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:56,072 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698832436071"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832436071"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832436071"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832436071"}]},"ts":"1698832436071"} 2023-11-01 09:53:56,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-01 09:53:56,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b12ce301cd7fb26d2cfa7146f93bc0fb, server=jenkins-hbase4.apache.org,40233,1698832432817 in 191 msec 2023-11-01 09:53:56,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-01 09:53:56,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b12ce301cd7fb26d2cfa7146f93bc0fb, ASSIGN in 360 msec 2023-11-01 09:53:56,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:53:56,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832436085"}]},"ts":"1698832436085"} 2023-11-01 09:53:56,087 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-01 09:53:56,091 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:53:56,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 532 msec 2023-11-01 09:53:56,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-01 09:53:56,172 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-01 09:53:56,172 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:53:56,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-01 09:53:56,222 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-01 09:53:56,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-11-01 09:53:56,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-01 09:53:56,252 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-01 09:53:56,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-11-01 09:53:56,266 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-01 09:53:56,269 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-01 09:53:56,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.341sec 2023-11-01 09:53:56,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-01 09:53:56,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-01 09:53:56,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-01 09:53:56,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41153,1698832431566-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-01 09:53:56,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41153,1698832431566-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-01 09:53:56,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-01 09:53:56,293 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(139): Connect 0x2da24397 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:53:56,297 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f49b0cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:53:56,309 DEBUG [hconnection-0x6e09da3c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:53:56,320 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:53:56,330 INFO [Listener at localhost/37085] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:53:56,331 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(139): Connect 0x339b0ded to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:53:56,336 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@635bcb93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:53:56,336 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:53:56,366 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=169, AvailableMemoryMB=11040 2023-11-01 09:53:56,377 DEBUG [Listener at localhost/37085] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:53:56,381 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:53:56,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-01 09:53:56,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:56,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:53:56,400 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:53:56,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-01 09:53:56,404 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:56,405 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 empty. 2023-11-01 09:53:56,406 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:56,406 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-01 09:53:56,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-01 09:53:56,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-01 09:53:56,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-01 09:53:56,824 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-01 09:53:56,826 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 710b0d496f991a4a7c3efb796275d459, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:53:56,843 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:56,843 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 710b0d496f991a4a7c3efb796275d459, disabling compactions & flushes 2023-11-01 09:53:56,843 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:56,843 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:56,843 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. after waiting 0 ms 2023-11-01 09:53:56,843 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:56,843 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:56,843 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:53:56,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:53:56,851 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832436850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832436850"}]},"ts":"1698832436850"} 2023-11-01 09:53:56,854 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:53:56,856 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:53:56,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832436856"}]},"ts":"1698832436856"} 2023-11-01 09:53:56,859 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-01 09:53:56,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, ASSIGN}] 2023-11-01 09:53:56,867 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, ASSIGN 2023-11-01 09:53:56,869 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:53:57,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=710b0d496f991a4a7c3efb796275d459, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:57,020 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832437020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832437020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832437020"}]},"ts":"1698832437020"} 2023-11-01 09:53:57,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-01 09:53:57,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 710b0d496f991a4a7c3efb796275d459, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:53:57,177 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:57,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:57,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 710b0d496f991a4a7c3efb796275d459, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:53:57,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:53:57,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,187 INFO [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,189 DEBUG [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:53:57,189 DEBUG [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:53:57,192 INFO [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 710b0d496f991a4a7c3efb796275d459 columnFamilyName family1 2023-11-01 09:53:57,195 INFO [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] regionserver.HStore(310): Store=710b0d496f991a4a7c3efb796275d459/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:53:57,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:53:57,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:53:57,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 710b0d496f991a4a7c3efb796275d459; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74869144, jitterRate=0.11563718318939209}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:53:57,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:53:57,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., pid=11, masterSystemTime=1698832437177 2023-11-01 09:53:57,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:57,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:57,212 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=710b0d496f991a4a7c3efb796275d459, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:57,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832437212"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832437212"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832437212"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832437212"}]},"ts":"1698832437212"} 2023-11-01 09:53:57,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-01 09:53:57,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 710b0d496f991a4a7c3efb796275d459, server=jenkins-hbase4.apache.org,40233,1698832432817 in 192 msec 2023-11-01 09:53:57,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-01 09:53:57,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, ASSIGN in 354 msec 2023-11-01 09:53:57,223 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:53:57,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832437223"}]},"ts":"1698832437223"} 2023-11-01 09:53:57,226 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-01 09:53:57,229 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:53:57,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 835 msec 2023-11-01 09:53:57,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-01 09:53:57,525 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-01 09:53:57,546 DEBUG [hconnection-0x406c7ec1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:53:57,549 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:53:57,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:53:57,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,720 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:53:57,721 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:53:57,721 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:53:57,721 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:53:57,722 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,722 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,725 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:53:57,725 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:57,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:53:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:53:57,725 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:57,725 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:53:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:53:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,727 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:57,733 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:53:57,733 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:53:57,734 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:53:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:53:57,735 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:53:57,736 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:53:57,737 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:53:58,288 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fe651b631fc74f5db97b34bcae7ac064 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fe651b631fc74f5db97b34bcae7ac064 2023-11-01 09:53:58,302 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/7bf089fde63a4632ae4e44cfdb9f821e 2023-11-01 09:53:58,311 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/7bf089fde63a4632ae4e44cfdb9f821e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7bf089fde63a4632ae4e44cfdb9f821e 2023-11-01 09:53:58,319 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7bf089fde63a4632ae4e44cfdb9f821e, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-01 09:53:58,322 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 585ms, sequenceid=5, compaction requested=false 2023-11-01 09:53:58,324 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:53:58,327 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:53:58,327 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:53:58,329 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:53:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:53:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:53:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:53:58,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:53:58,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:53:58,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f3689b7[Count = 0] remaining members to acquire global barrier 2023-11-01 09:53:58,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,336 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:53:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:53:58,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:53:58,336 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,336 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:53:58,338 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:53:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:53:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:53:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:53:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:53:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:53:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:53:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:53:58,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:53:58,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:53:58,344 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:53:58,344 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:53:58,344 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:53:58,344 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,344 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:53:58,346 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,347 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,347 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:53:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:53:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:53:58,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:53:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:53:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:53:58,348 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:53:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,350 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:53:58,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,359 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:53:58,359 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:53:58,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:53:58,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:53:58,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:53:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:53:58,359 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:53:58,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:53:58,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:53:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,361 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:53:58,362 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:53:58,462 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:53:58,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:53:58,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:53:58,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:53:58,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,480 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:53:58,480 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:53:58,480 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:53:58,480 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:53:58,481 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,481 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,484 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:53:58,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:53:58,484 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:53:58,484 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:58,484 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:53:58,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:53:58,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,485 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,485 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:53:58,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:58,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:53:58,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:53:58,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:53:58,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:53:58,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:53:58,486 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:58,486 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:53:58,487 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:53:58,912 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a8490beab82042efa72f239d8fd3a9ff to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a8490beab82042efa72f239d8fd3a9ff 2023-11-01 09:53:59,322 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/c1bc7827ebcf4bdead5a6cf682523703 2023-11-01 09:53:59,332 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/c1bc7827ebcf4bdead5a6cf682523703 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/c1bc7827ebcf4bdead5a6cf682523703 2023-11-01 09:53:59,340 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/c1bc7827ebcf4bdead5a6cf682523703, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:53:59,341 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 854ms, sequenceid=9, compaction requested=false 2023-11-01 09:53:59,341 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:53:59,341 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:59,341 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:53:59,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:53:59,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:53:59,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:53:59,344 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,344 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:53:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:53:59,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:53:59,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:53:59,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:53:59,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:53:59,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:53:59,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@292645b7[Count = 0] remaining members to acquire global barrier 2023-11-01 09:53:59,347 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:53:59,347 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,348 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,348 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:53:59,348 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:53:59,348 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:53:59,348 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,348 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:53:59,350 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:53:59,350 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,350 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:53:59,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:53:59,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:53:59,350 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:53:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:53:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:53:59,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:53:59,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:53:59,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:53:59,353 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:53:59,354 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:53:59,354 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:53:59,354 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,354 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:53:59,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:53:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:53:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:53:59,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:53:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:53:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:53:59,363 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:53:59,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,365 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:53:59,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,368 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,368 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,368 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:53:59,368 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:53:59,369 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:53:59,369 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:53:59,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:53:59,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:53:59,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:53:59,369 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,369 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,369 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,369 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:53:59,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:53:59,370 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:53:59,370 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:53:59,470 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:53:59,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:53:59,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:53:59,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:53:59,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,482 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:53:59,482 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:53:59,482 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:53:59,482 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:53:59,483 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,483 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,484 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,484 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:53:59,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:53:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:53:59,485 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:53:59,485 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:53:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:53:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:53:59,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:53:59,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:53:59,486 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:53:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:53:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:53:59,487 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:53:59,487 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:53:59,487 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:53:59,487 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:53:59,911 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cf4ef41696744a5eab857ff45ea82471 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201cf4ef41696744a5eab857ff45ea82471 2023-11-01 09:54:00,100 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-01 09:54:00,101 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-01 09:54:00,324 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/72a8da20daf84cbb94afb033443c214c 2023-11-01 09:54:00,340 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/72a8da20daf84cbb94afb033443c214c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/72a8da20daf84cbb94afb033443c214c 2023-11-01 09:54:00,354 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/72a8da20daf84cbb94afb033443c214c, entries=1, sequenceid=13, filesize=5.0 K 2023-11-01 09:54:00,356 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 869ms, sequenceid=13, compaction requested=true 2023-11-01 09:54:00,356 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:00,356 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:00,358 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:00,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:00,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799cd08[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:00,361 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:00,361 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,363 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:00,364 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,364 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:00,365 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:00,365 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,365 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:00,366 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:00,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:00,369 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:00,369 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:00,369 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:00,370 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,370 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:00,372 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,372 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:00,372 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:00,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:00,373 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:00,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,375 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:00,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:00,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:00,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:00,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:00,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:00,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:00,379 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:00,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:00,380 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:00,380 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,380 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,380 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:00,381 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:00,481 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:00,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:00,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:00,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:00,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,494 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:00,494 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:00,494 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:00,494 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:00,495 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,495 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,500 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:00,500 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:00,501 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,501 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:00,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,502 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:00,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,502 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:00,502 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:00,503 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:00,503 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:00,503 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:00,503 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:00,532 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f1211b15278f49a3bedb50efdefaebcc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f1211b15278f49a3bedb50efdefaebcc 2023-11-01 09:54:00,851 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:54:00,944 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/2cebd191b8044cbc9677202d6d4c48ea 2023-11-01 09:54:00,956 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/2cebd191b8044cbc9677202d6d4c48ea as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2cebd191b8044cbc9677202d6d4c48ea 2023-11-01 09:54:00,964 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2cebd191b8044cbc9677202d6d4c48ea, entries=1, sequenceid=17, filesize=5.0 K 2023-11-01 09:54:00,965 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 462ms, sequenceid=17, compaction requested=true 2023-11-01 09:54:00,965 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:00,965 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:00,965 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:00,968 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,968 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:00,969 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,969 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:00,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:00,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33a478c[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:00,971 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:00,971 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,972 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:00,973 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:00,973 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:00,973 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,973 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:00,975 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:00,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,975 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:00,975 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:00,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:00,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:00,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:00,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:00,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:00,980 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:00,980 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:00,980 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:00,980 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,980 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:00,983 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,983 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,983 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:00,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:00,984 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,986 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,992 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,992 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:00,992 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:00,992 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:00,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:00,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:00,992 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:00,992 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,993 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:00,993 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,993 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,993 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:00,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:00,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:00,993 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:00,994 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:01,094 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:01,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:01,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:01,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:01,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,105 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:01,105 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:01,106 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:01,106 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:01,107 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,107 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,108 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:01,108 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:01,109 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,109 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,110 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:01,111 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:01,111 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:01,111 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:01,136 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228affcf7caca224e2489eb722a9088c405 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228affcf7caca224e2489eb722a9088c405 2023-11-01 09:54:01,550 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/61a6d971cbd3465d9d2a5f2692a0a424 2023-11-01 09:54:01,560 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/61a6d971cbd3465d9d2a5f2692a0a424 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/61a6d971cbd3465d9d2a5f2692a0a424 2023-11-01 09:54:01,569 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/61a6d971cbd3465d9d2a5f2692a0a424, entries=1, sequenceid=21, filesize=5.0 K 2023-11-01 09:54:01,571 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 460ms, sequenceid=21, compaction requested=true 2023-11-01 09:54:01,571 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:01,571 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:01,571 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:01,571 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:01,571 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,571 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:01,571 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:01,577 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,577 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:01,577 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,577 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:01,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:01,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84a0d6d[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:01,579 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:01,580 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,581 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,581 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:01,581 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:01,581 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:01,581 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,581 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:01,583 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:01,583 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,583 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:01,583 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:01,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:01,586 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:01,586 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:01,586 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:01,586 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,586 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:01,588 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,588 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:01,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,588 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:01,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:01,589 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:01,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,590 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:01,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:01,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:01,595 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:01,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:01,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:01,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:54:01,595 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,595 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:01,595 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,595 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,596 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:01,596 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:01,596 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:01,696 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:01,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:01,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:01,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:01,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,709 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:01,709 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:01,710 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:01,710 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:01,711 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,711 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,712 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:01,712 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:01,713 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:01,713 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:01,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:01,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:01,714 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:01,715 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:01,715 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:01,715 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:01,716 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:01,737 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-01 09:54:01,738 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-01 09:54:01,741 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c650fb4861b54b109f6ed164923000b2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c650fb4861b54b109f6ed164923000b2 2023-11-01 09:54:02,153 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/bfb8f374494f4eed8d80e9d1da2d8813 2023-11-01 09:54:02,163 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/bfb8f374494f4eed8d80e9d1da2d8813 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/bfb8f374494f4eed8d80e9d1da2d8813 2023-11-01 09:54:02,171 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/bfb8f374494f4eed8d80e9d1da2d8813, entries=1, sequenceid=25, filesize=5.0 K 2023-11-01 09:54:02,173 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 457ms, sequenceid=25, compaction requested=true 2023-11-01 09:54:02,173 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:02,173 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:02,173 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:02,174 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:02,174 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,174 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:02,174 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:02,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,176 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,177 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,177 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:02,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:02,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13dafa2e[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:02,179 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:02,179 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,181 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,181 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:02,181 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:02,181 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:02,181 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,181 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:02,184 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:02,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:02,188 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:02,188 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:02,189 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:02,189 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,189 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:02,191 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,191 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:02,192 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,193 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,195 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,198 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,198 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,198 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:02,198 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:02,198 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:02,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:02,199 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:02,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:02,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:54:02,198 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:02,200 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,200 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,200 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,200 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:02,200 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:02,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:02,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:02,300 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:02,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:02,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:02,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:02,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,312 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:02,312 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:02,313 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:02,313 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:02,313 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,313 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,315 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,315 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:02,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:02,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:02,316 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,316 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:02,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,317 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:02,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:02,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:02,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:02,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:02,318 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:02,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:02,318 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:02,319 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:02,348 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101de30683283f94a198117f0987461c75e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101de30683283f94a198117f0987461c75e 2023-11-01 09:54:02,393 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/2f6d8b93acd1437686608b36d8ec8411 2023-11-01 09:54:02,402 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/2f6d8b93acd1437686608b36d8ec8411 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2f6d8b93acd1437686608b36d8ec8411 2023-11-01 09:54:02,411 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2f6d8b93acd1437686608b36d8ec8411, entries=1, sequenceid=29, filesize=5.0 K 2023-11-01 09:54:02,413 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 94ms, sequenceid=29, compaction requested=true 2023-11-01 09:54:02,413 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:02,414 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:02,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:02,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:02,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:02,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:02,418 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:02,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a6294d0[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:02,421 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:02,421 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,422 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:02,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:02,424 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:02,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,424 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,424 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:02,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:02,428 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:02,428 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:02,428 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:02,428 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,428 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:02,432 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,433 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,433 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:02,433 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,435 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:02,439 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:02,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,440 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:02,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:02,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:02,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:02,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:54:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:02,440 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,440 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,440 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,440 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:02,441 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:02,441 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:02,541 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:02,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:02,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:02,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:02,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,554 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:02,554 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:02,554 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:02,554 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:02,555 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,555 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,557 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:02,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:02,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:02,557 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,557 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,559 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:02,559 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:02,559 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:02,560 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:02,560 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:02,560 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:02,560 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:02,560 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:02,582 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e9f737c6a9a44b5ebfefc872ca11cd08 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9f737c6a9a44b5ebfefc872ca11cd08 2023-11-01 09:54:02,592 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/d2fbedf9beca489aaa150c8495798ce8 2023-11-01 09:54:02,599 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/d2fbedf9beca489aaa150c8495798ce8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/d2fbedf9beca489aaa150c8495798ce8 2023-11-01 09:54:02,606 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/d2fbedf9beca489aaa150c8495798ce8, entries=1, sequenceid=33, filesize=5.0 K 2023-11-01 09:54:02,608 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 48ms, sequenceid=33, compaction requested=true 2023-11-01 09:54:02,608 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:02,608 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:02,608 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:02,611 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,611 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,611 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,611 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:02,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:02,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb5ae37[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:02,614 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:02,614 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,615 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,615 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:02,615 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:02,615 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:02,615 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,615 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:02,617 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,617 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:02,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,617 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:02,617 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:02,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:02,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:02,626 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:02,626 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:02,626 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:02,626 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,626 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:02,628 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,628 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:02,628 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:02,629 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,631 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,636 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:02,636 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:02,636 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:02,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:02,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:02,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:54:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:02,636 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,637 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:02,737 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:02,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:02,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:02,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,751 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:02,751 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:02,752 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:02,752 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:02,753 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,753 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,754 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:02,754 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:02,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:02,755 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:02,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,755 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:02,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,757 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:02,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:02,757 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:02,757 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:02,757 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:02,758 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:02,758 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:02,758 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:02,758 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:02,758 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:03,182 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b9b83fd83bfd4401944ddb38572ab7e1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907b9b83fd83bfd4401944ddb38572ab7e1 2023-11-01 09:54:03,197 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/1c0fb9598e8d4efa9455071d02bea8f0 2023-11-01 09:54:03,209 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/1c0fb9598e8d4efa9455071d02bea8f0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/1c0fb9598e8d4efa9455071d02bea8f0 2023-11-01 09:54:03,218 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/1c0fb9598e8d4efa9455071d02bea8f0, entries=1, sequenceid=37, filesize=5.0 K 2023-11-01 09:54:03,220 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 462ms, sequenceid=37, compaction requested=true 2023-11-01 09:54:03,220 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:03,220 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:03,220 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:03,223 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,223 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:03,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:03,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:03,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:03,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:03,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53cceb49[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:03,226 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:03,226 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,228 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,228 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:03,228 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:03,228 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:03,228 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,228 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:03,231 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:03,231 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:03,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:03,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:03,235 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:03,235 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:03,235 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:03,235 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,235 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:03,237 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,237 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,237 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:03,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:03,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:03,238 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:03,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,241 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:03,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,244 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,244 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,244 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:03,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:03,244 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:03,244 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,245 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,245 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,245 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,248 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:03,248 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:03,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:03,248 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:03,248 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:03,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:03,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:54:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:03,349 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:03,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:03,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:03,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:03,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,361 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:03,361 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:03,362 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-01 09:54:03,362 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-01 09:54:03,363 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,363 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,364 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:03,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:03,364 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:03,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,365 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,365 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:03,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,368 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-01 09:54:03,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,368 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-01 09:54:03,368 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:03,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-01 09:54:03,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:03,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:03,370 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:03,370 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. started... 2023-11-01 09:54:03,370 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 710b0d496f991a4a7c3efb796275d459 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:03,392 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b7606a758c0f4d5ea83f9d10a4a1426d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b7606a758c0f4d5ea83f9d10a4a1426d 2023-11-01 09:54:03,809 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/600a877a5071482581a6051769cb3a1a 2023-11-01 09:54:03,818 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/600a877a5071482581a6051769cb3a1a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/600a877a5071482581a6051769cb3a1a 2023-11-01 09:54:03,825 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/600a877a5071482581a6051769cb3a1a, entries=1, sequenceid=41, filesize=5.0 K 2023-11-01 09:54:03,826 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 710b0d496f991a4a7c3efb796275d459 in 456ms, sequenceid=41, compaction requested=true 2023-11-01 09:54:03,827 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:03,827 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-01 09:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-01 09:54:03,829 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,829 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:03,830 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,830 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-01 09:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17836094[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:03,832 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-01 09:54:03,832 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,833 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,833 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-01 09:54:03,833 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-01 09:54:03,833 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:03,833 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,834 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:03,839 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,839 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-01 09:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:03,839 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:03,839 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-01 09:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:03,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-01 09:54:03,843 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-01 09:54:03,843 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:03,843 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:03,843 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,843 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:03,845 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,845 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:03,845 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,845 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:03,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,847 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,849 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,849 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:03,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:03,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-01 09:54:03,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-01 09:54:03,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:03,850 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:03,851 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:03,851 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:03,951 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:03,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:03,957 DEBUG [Listener at localhost/37085] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-01 09:54:03,960 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-01 09:54:03,961 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:03,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:03,979 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:03,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:03,981 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833043981 2023-11-01 09:54:03,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:54:03,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-01 09:54:03,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:03,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x303e3570 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:03,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78e54361, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:03,996 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,089 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c53922ba7a694debbd0d6efd90eca90c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c53922ba7a694debbd0d6efd90eca90c 2023-11-01 09:54:04,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:04,112 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:04,113 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:04,129 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:04,133 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:04,186 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3900ed6043a4a68afa63977b44ef920 first=Optional[r3] last=Optional[r6] 2023-11-01 09:54:04,200 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3900ed6043a4a68afa63977b44ef920}] 2023-11-01 09:54:04,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3900ed6043a4a68afa63977b44ef920 for inclusion in 710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:04,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-01 09:54:04,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:04,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:04,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3900ed6043a4a68afa63977b44ef920 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5ia2rc0kji6egpq9gqah6vmr4ov7lcrou4pe4a9603fag6ongcfg4lf2dq7n3oa4/family1/a3900ed6043a4a68afa63977b44ef920 2023-11-01 09:54:04,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5ia2rc0kji6egpq9gqah6vmr4ov7lcrou4pe4a9603fag6ongcfg4lf2dq7n3oa4/family1/a3900ed6043a4a68afa63977b44ef920 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_ 2023-11-01 09:54:04,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5ia2rc0kji6egpq9gqah6vmr4ov7lcrou4pe4a9603fag6ongcfg4lf2dq7n3oa4/family1/a3900ed6043a4a68afa63977b44ef920 into 710b0d496f991a4a7c3efb796275d459/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_ - updating store file list. 2023-11-01 09:54:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_ into 710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5ia2rc0kji6egpq9gqah6vmr4ov7lcrou4pe4a9603fag6ongcfg4lf2dq7n3oa4/family1/a3900ed6043a4a68afa63977b44ef920 into 710b0d496f991a4a7c3efb796275d459/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_) 2023-11-01 09:54:04,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5ia2rc0kji6egpq9gqah6vmr4ov7lcrou4pe4a9603fag6ongcfg4lf2dq7n3oa4/family1/a3900ed6043a4a68afa63977b44ef920 2023-11-01 09:54:04,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:54:04,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:54:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 710b0d496f991a4a7c3efb796275d459/family1 is initiating minor compaction 2023-11-01 09:54:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4fd6e5be; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:04,253 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 710b0d496f991a4a7c3efb796275d459/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:04,254 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/c1bc7827ebcf4bdead5a6cf682523703, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/72a8da20daf84cbb94afb033443c214c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2cebd191b8044cbc9677202d6d4c48ea, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/61a6d971cbd3465d9d2a5f2692a0a424, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/bfb8f374494f4eed8d80e9d1da2d8813, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2f6d8b93acd1437686608b36d8ec8411, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/d2fbedf9beca489aaa150c8495798ce8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/1c0fb9598e8d4efa9455071d02bea8f0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/600a877a5071482581a6051769cb3a1a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp, totalSize=50.2 K 2023-11-01 09:54:04,255 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting c1bc7827ebcf4bdead5a6cf682523703, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:54:04,255 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 72a8da20daf84cbb94afb033443c214c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:54:04,255 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 2cebd191b8044cbc9677202d6d4c48ea, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:54:04,255 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 61a6d971cbd3465d9d2a5f2692a0a424, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:54:04,255 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting bfb8f374494f4eed8d80e9d1da2d8813, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:54:04,255 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 2f6d8b93acd1437686608b36d8ec8411, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:54:04,256 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting d2fbedf9beca489aaa150c8495798ce8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:54:04,256 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 1c0fb9598e8d4efa9455071d02bea8f0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:54:04,256 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 600a877a5071482581a6051769cb3a1a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:54:04,256 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting b598688003c144089f97b5d03e4377d1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:54:04,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:04,274 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:04,281 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228affcf7caca224e2489eb722a9088c405 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228affcf7caca224e2489eb722a9088c405 2023-11-01 09:54:04,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c650fb4861b54b109f6ed164923000b2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c650fb4861b54b109f6ed164923000b2 2023-11-01 09:54:04,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101de30683283f94a198117f0987461c75e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101de30683283f94a198117f0987461c75e 2023-11-01 09:54:04,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9f737c6a9a44b5ebfefc872ca11cd08 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9f737c6a9a44b5ebfefc872ca11cd08 2023-11-01 09:54:04,288 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-01 09:54:04,288 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-01 09:54:04,289 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,289 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,289 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,289 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,386 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 710b0d496f991a4a7c3efb796275d459#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:04,457 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/7dccd73178bb4d73b755952352866f38 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7dccd73178bb4d73b755952352866f38 2023-11-01 09:54:04,461 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055ac3430055f14b12a05fc52e5b92d392 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055ac3430055f14b12a05fc52e5b92d392 2023-11-01 09:54:04,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:04,475 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 710b0d496f991a4a7c3efb796275d459/family1 of 710b0d496f991a4a7c3efb796275d459 into 7dccd73178bb4d73b755952352866f38(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:04,476 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:04,478 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698832444251; duration=0sec 2023-11-01 09:54:04,479 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:04,501 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8444fef165524eec8418d446ff226059 first=Optional[r00] last=Optional[r2] 2023-11-01 09:54:04,502 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8444fef165524eec8418d446ff226059}] 2023-11-01 09:54:04,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8444fef165524eec8418d446ff226059 for inclusion in 710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:04,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-01 09:54:04,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:04,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:04,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8444fef165524eec8418d446ff226059 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bpc3f1jk9epcie72c8mv65kppfpmh9kog18ti5v4bfgnik709t883he07fl9tt9h/family1/8444fef165524eec8418d446ff226059 2023-11-01 09:54:04,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bpc3f1jk9epcie72c8mv65kppfpmh9kog18ti5v4bfgnik709t883he07fl9tt9h/family1/8444fef165524eec8418d446ff226059 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_ 2023-11-01 09:54:04,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bpc3f1jk9epcie72c8mv65kppfpmh9kog18ti5v4bfgnik709t883he07fl9tt9h/family1/8444fef165524eec8418d446ff226059 into 710b0d496f991a4a7c3efb796275d459/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_ - updating store file list. 2023-11-01 09:54:04,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_ into 710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:04,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bpc3f1jk9epcie72c8mv65kppfpmh9kog18ti5v4bfgnik709t883he07fl9tt9h/family1/8444fef165524eec8418d446ff226059 into 710b0d496f991a4a7c3efb796275d459/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_) 2023-11-01 09:54:04,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bpc3f1jk9epcie72c8mv65kppfpmh9kog18ti5v4bfgnik709t883he07fl9tt9h/family1/8444fef165524eec8418d446ff226059 2023-11-01 09:54:04,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:54:04,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:54:04,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 710b0d496f991a4a7c3efb796275d459/family1 is initiating minor compaction (all files) 2023-11-01 09:54:04,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@678b83bb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:04,521 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 710b0d496f991a4a7c3efb796275d459/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:04,521 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7bf089fde63a4632ae4e44cfdb9f821e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7dccd73178bb4d73b755952352866f38, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp, totalSize=358.6 K 2023-11-01 09:54:04,522 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 7bf089fde63a4632ae4e44cfdb9f821e, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:54:04,522 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 7dccd73178bb4d73b755952352866f38, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:54:04,523 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting b297c31d5a804f798ead52d731f4a0a1_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878856338 2023-11-01 09:54:04,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:04,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:04,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fe651b631fc74f5db97b34bcae7ac064 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fe651b631fc74f5db97b34bcae7ac064 2023-11-01 09:54:04,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201cf4ef41696744a5eab857ff45ea82471 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201cf4ef41696744a5eab857ff45ea82471 2023-11-01 09:54:04,531 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f1211b15278f49a3bedb50efdefaebcc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f1211b15278f49a3bedb50efdefaebcc 2023-11-01 09:54:04,531 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-01 09:54:04,531 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-01 09:54:04,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:04,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:04,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:04,533 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:04,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 566 msec 2023-11-01 09:54:04,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/c1bc7827ebcf4bdead5a6cf682523703, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/72a8da20daf84cbb94afb033443c214c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2cebd191b8044cbc9677202d6d4c48ea, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/61a6d971cbd3465d9d2a5f2692a0a424, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/bfb8f374494f4eed8d80e9d1da2d8813, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2f6d8b93acd1437686608b36d8ec8411, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/d2fbedf9beca489aaa150c8495798ce8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/1c0fb9598e8d4efa9455071d02bea8f0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/600a877a5071482581a6051769cb3a1a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_] to archive 2023-11-01 09:54:04,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:04,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/c1bc7827ebcf4bdead5a6cf682523703 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/c1bc7827ebcf4bdead5a6cf682523703 2023-11-01 09:54:04,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/72a8da20daf84cbb94afb033443c214c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/72a8da20daf84cbb94afb033443c214c 2023-11-01 09:54:04,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2cebd191b8044cbc9677202d6d4c48ea to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2cebd191b8044cbc9677202d6d4c48ea 2023-11-01 09:54:04,576 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 710b0d496f991a4a7c3efb796275d459#family1#compaction#11 average throughput is 4.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:04,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/61a6d971cbd3465d9d2a5f2692a0a424 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/61a6d971cbd3465d9d2a5f2692a0a424 2023-11-01 09:54:04,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/bfb8f374494f4eed8d80e9d1da2d8813 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/bfb8f374494f4eed8d80e9d1da2d8813 2023-11-01 09:54:04,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2f6d8b93acd1437686608b36d8ec8411 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/2f6d8b93acd1437686608b36d8ec8411 2023-11-01 09:54:04,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/d2fbedf9beca489aaa150c8495798ce8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/d2fbedf9beca489aaa150c8495798ce8 2023-11-01 09:54:04,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/1c0fb9598e8d4efa9455071d02bea8f0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/1c0fb9598e8d4efa9455071d02bea8f0 2023-11-01 09:54:04,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/600a877a5071482581a6051769cb3a1a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/600a877a5071482581a6051769cb3a1a 2023-11-01 09:54:04,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b598688003c144089f97b5d03e4377d1_SeqId_44_ 2023-11-01 09:54:04,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-01 09:54:04,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:04,765 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-01 09:54:04,767 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:04,768 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-01 09:54:04,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-01 09:54:04,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, REOPEN/MOVE}] 2023-11-01 09:54:04,787 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, REOPEN/MOVE 2023-11-01 09:54:04,788 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=710b0d496f991a4a7c3efb796275d459, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:04,788 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832444788"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832444788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832444788"}]},"ts":"1698832444788"} 2023-11-01 09:54:04,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 710b0d496f991a4a7c3efb796275d459, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:04,949 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:04,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:04,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 710b0d496f991a4a7c3efb796275d459, disabling compactions & flushes 2023-11-01 09:54:04,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,039 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/.tmp/family1/00f26b1a53a44e79a84bda7d1c2edf8a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/00f26b1a53a44e79a84bda7d1c2edf8a 2023-11-01 09:54:05,047 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 710b0d496f991a4a7c3efb796275d459/family1 of 710b0d496f991a4a7c3efb796275d459 into 00f26b1a53a44e79a84bda7d1c2edf8a(size=177.6 K), total size for store is 177.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:05,047 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:05,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,048 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698832444520; duration=0sec 2023-11-01 09:54:05,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. after waiting 0 ms 2023-11-01 09:54:05,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:05,050 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7bf089fde63a4632ae4e44cfdb9f821e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7dccd73178bb4d73b755952352866f38, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_] to archive 2023-11-01 09:54:05,051 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:05,053 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7bf089fde63a4632ae4e44cfdb9f821e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7bf089fde63a4632ae4e44cfdb9f821e 2023-11-01 09:54:05,055 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7dccd73178bb4d73b755952352866f38 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/7dccd73178bb4d73b755952352866f38 2023-11-01 09:54:05,057 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/b297c31d5a804f798ead52d731f4a0a1_SeqId_47_ 2023-11-01 09:54:05,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-01 09:54:05,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:05,066 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 710b0d496f991a4a7c3efb796275d459 to self. 2023-11-01 09:54:05,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,070 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=710b0d496f991a4a7c3efb796275d459, regionState=CLOSED 2023-11-01 09:54:05,070 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832445069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832445069"}]},"ts":"1698832445069"} 2023-11-01 09:54:05,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-01 09:54:05,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 710b0d496f991a4a7c3efb796275d459, server=jenkins-hbase4.apache.org,40233,1698832432817 in 280 msec 2023-11-01 09:54:05,075 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=true 2023-11-01 09:54:05,225 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=710b0d496f991a4a7c3efb796275d459, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:05,226 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832445225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832445225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832445225"}]},"ts":"1698832445225"} 2023-11-01 09:54:05,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 710b0d496f991a4a7c3efb796275d459, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:05,381 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:05,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 710b0d496f991a4a7c3efb796275d459, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:54:05,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:05,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,387 INFO [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,388 DEBUG [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:05,388 DEBUG [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:05,388 INFO [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 710b0d496f991a4a7c3efb796275d459 columnFamilyName family1 2023-11-01 09:54:05,395 DEBUG [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/00f26b1a53a44e79a84bda7d1c2edf8a 2023-11-01 09:54:05,396 INFO [StoreOpener-710b0d496f991a4a7c3efb796275d459-1] regionserver.HStore(310): Store=710b0d496f991a4a7c3efb796275d459/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:05,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:54:05,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 710b0d496f991a4a7c3efb796275d459; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69810049, jitterRate=0.04025079309940338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:54:05,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:05,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., pid=17, masterSystemTime=1698832445381 2023-11-01 09:54:05,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:54:05,405 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=710b0d496f991a4a7c3efb796275d459, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:05,405 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698832445405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832445405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832445405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832445405"}]},"ts":"1698832445405"} 2023-11-01 09:54:05,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-01 09:54:05,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 710b0d496f991a4a7c3efb796275d459, server=jenkins-hbase4.apache.org,40233,1698832432817 in 180 msec 2023-11-01 09:54:05,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-01 09:54:05,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=710b0d496f991a4a7c3efb796275d459, REOPEN/MOVE in 624 msec 2023-11-01 09:54:05,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-01 09:54:05,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 643 msec 2023-11-01 09:54:05,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 674 msec 2023-11-01 09:54:05,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-01 09:54:05,429 INFO [Listener at localhost/37085] compactions.TestMobCompactor(278): alter status finished 2023-11-01 09:54:05,430 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-01 09:54:05,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:05,433 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:05,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:05,433 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833045433 2023-11-01 09:54:05,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:54:05,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-01 09:54:05,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:05,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x1f47bf1f to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:05,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47b9ac0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:05,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:05,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:05,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:05,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:05,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:06,286 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f6030354261d417e8ebc53cf3354939c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f6030354261d417e8ebc53cf3354939c 2023-11-01 09:54:06,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:06,337 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:54:06,337 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:06,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x303e3570 to 127.0.0.1:49762 2023-11-01 09:54:06,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:54:06,340 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:06,355 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:06,357 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:06,368 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/789a2bde19084f1ba3e27cb801d0d51c first=Optional[r05] last=Optional[r8] 2023-11-01 09:54:06,369 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/789a2bde19084f1ba3e27cb801d0d51c}] 2023-11-01 09:54:06,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/789a2bde19084f1ba3e27cb801d0d51c for inclusion in 710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:06,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-01 09:54:06,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:06,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:54:06,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/789a2bde19084f1ba3e27cb801d0d51c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kaskoscq6esoe3dgd29ruo52ed5bnrt1q4cn0dn5do1vkuvn5tskos75jfi06boc/family1/789a2bde19084f1ba3e27cb801d0d51c 2023-11-01 09:54:06,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kaskoscq6esoe3dgd29ruo52ed5bnrt1q4cn0dn5do1vkuvn5tskos75jfi06boc/family1/789a2bde19084f1ba3e27cb801d0d51c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/3e243cadd6964e91952e0b8771a3f511_SeqId_53_ 2023-11-01 09:54:06,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kaskoscq6esoe3dgd29ruo52ed5bnrt1q4cn0dn5do1vkuvn5tskos75jfi06boc/family1/789a2bde19084f1ba3e27cb801d0d51c into 710b0d496f991a4a7c3efb796275d459/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/3e243cadd6964e91952e0b8771a3f511_SeqId_53_ - updating store file list. 2023-11-01 09:54:06,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/3e243cadd6964e91952e0b8771a3f511_SeqId_53_ into 710b0d496f991a4a7c3efb796275d459/family1 2023-11-01 09:54:06,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kaskoscq6esoe3dgd29ruo52ed5bnrt1q4cn0dn5do1vkuvn5tskos75jfi06boc/family1/789a2bde19084f1ba3e27cb801d0d51c into 710b0d496f991a4a7c3efb796275d459/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/family1/3e243cadd6964e91952e0b8771a3f511_SeqId_53_) 2023-11-01 09:54:06,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kaskoscq6esoe3dgd29ruo52ed5bnrt1q4cn0dn5do1vkuvn5tskos75jfi06boc/family1/789a2bde19084f1ba3e27cb801d0d51c 2023-11-01 09:54:06,391 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:06,392 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:06,394 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b7606a758c0f4d5ea83f9d10a4a1426d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b7606a758c0f4d5ea83f9d10a4a1426d 2023-11-01 09:54:06,396 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a8490beab82042efa72f239d8fd3a9ff to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a8490beab82042efa72f239d8fd3a9ff 2023-11-01 09:54:06,396 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-01 09:54:06,396 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-01 09:54:06,397 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:06,397 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:06,397 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-01 09:54:06,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-01 09:54:06,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:06,398 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:06,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 967 msec 2023-11-01 09:54:06,489 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=244 (was 213) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49762@0x1f47bf1f-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:57894 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58056 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58112 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58038 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49762@0x1f47bf1f sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/719220859.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58044 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58090 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130119562_17 at /127.0.0.1:58138 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52db00a3-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:57932 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58022 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52db00a3-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:57990 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:57850 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:57874 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52db00a3-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58066 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49762@0x1f47bf1f-SendThread(127.0.0.1:49762) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58120 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58098 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:57970 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:40233-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=599 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 318) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=11169 (was 11040) - AvailableMemoryMB LEAK? - 2023-11-01 09:54:06,502 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=244, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=169, AvailableMemoryMB=11168 2023-11-01 09:54:06,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-01 09:54:06,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:06,509 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:54:06,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-01 09:54:06,510 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:54:06,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-01 09:54:06,513 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:06,514 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427 empty. 2023-11-01 09:54:06,514 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:06,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-01 09:54:06,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-01 09:54:06,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-01 09:54:06,925 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:06,926 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 70058c73ccbece118d377978f7fa6427, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:06,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:06,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 70058c73ccbece118d377978f7fa6427, disabling compactions & flushes 2023-11-01 09:54:06,936 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:06,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:06,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. after waiting 0 ms 2023-11-01 09:54:06,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:06,936 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:06,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:06,939 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:54:06,940 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698832446940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832446940"}]},"ts":"1698832446940"} 2023-11-01 09:54:06,942 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:54:06,943 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:54:06,943 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832446943"}]},"ts":"1698832446943"} 2023-11-01 09:54:06,945 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-01 09:54:06,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=70058c73ccbece118d377978f7fa6427, ASSIGN}] 2023-11-01 09:54:06,951 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=70058c73ccbece118d377978f7fa6427, ASSIGN 2023-11-01 09:54:06,952 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=70058c73ccbece118d377978f7fa6427, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:07,102 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=70058c73ccbece118d377978f7fa6427, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698832447102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832447102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832447102"}]},"ts":"1698832447102"} 2023-11-01 09:54:07,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 70058c73ccbece118d377978f7fa6427, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:07,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-01 09:54:07,258 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:07,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70058c73ccbece118d377978f7fa6427, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:54:07,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:07,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,264 INFO [StoreOpener-70058c73ccbece118d377978f7fa6427-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,265 DEBUG [StoreOpener-70058c73ccbece118d377978f7fa6427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:07,265 DEBUG [StoreOpener-70058c73ccbece118d377978f7fa6427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:07,266 INFO [StoreOpener-70058c73ccbece118d377978f7fa6427-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70058c73ccbece118d377978f7fa6427 columnFamilyName family1 2023-11-01 09:54:07,267 INFO [StoreOpener-70058c73ccbece118d377978f7fa6427-1] regionserver.HStore(310): Store=70058c73ccbece118d377978f7fa6427/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:07,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 70058c73ccbece118d377978f7fa6427 2023-11-01 09:54:07,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:07,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 70058c73ccbece118d377978f7fa6427; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65415402, jitterRate=-0.02523455023765564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:54:07,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:07,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427., pid=21, masterSystemTime=1698832447258 2023-11-01 09:54:07,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:07,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:07,279 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=70058c73ccbece118d377978f7fa6427, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,279 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698832447278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832447278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832447278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832447278"}]},"ts":"1698832447278"} 2023-11-01 09:54:07,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-01 09:54:07,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 70058c73ccbece118d377978f7fa6427, server=jenkins-hbase4.apache.org,40233,1698832432817 in 175 msec 2023-11-01 09:54:07,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-01 09:54:07,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=70058c73ccbece118d377978f7fa6427, ASSIGN in 334 msec 2023-11-01 09:54:07,286 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:54:07,286 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832447286"}]},"ts":"1698832447286"} 2023-11-01 09:54:07,288 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-01 09:54:07,290 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:54:07,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 785 msec 2023-11-01 09:54:07,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-01 09:54:07,618 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-01 09:54:07,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:07,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,669 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:07,669 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:07,670 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:07,670 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:07,670 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,670 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,672 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,672 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:07,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:07,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:07,672 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,672 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:07,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,673 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:07,673 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:07,674 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:07,677 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:07,677 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:07,677 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:07,677 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:07,678 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:54:07,705 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113016d8b9d802864375a75faf3201d2613b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113016d8b9d802864375a75faf3201d2613b 2023-11-01 09:54:07,709 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/4a5a7be00f674ecdab8dfaeb3f381b3c 2023-11-01 09:54:07,716 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/4a5a7be00f674ecdab8dfaeb3f381b3c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4a5a7be00f674ecdab8dfaeb3f381b3c 2023-11-01 09:54:07,723 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4a5a7be00f674ecdab8dfaeb3f381b3c, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-01 09:54:07,724 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 47ms, sequenceid=5, compaction requested=false 2023-11-01 09:54:07,724 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:07,725 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:07,725 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:07,725 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:07,725 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:07,725 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,725 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:07,725 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:07,727 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,727 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:07,727 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,727 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:07,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:07,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5989b2a0[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:07,729 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:07,729 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,731 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:07,732 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,732 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:07,733 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:07,733 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,733 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:07,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:07,733 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:07,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:07,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:07,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:07,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:07,737 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:07,737 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:07,737 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:07,737 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,737 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:07,739 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,739 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,739 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:07,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:07,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:07,740 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:07,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:07,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,741 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:07,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,744 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,744 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,744 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,745 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,745 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:07,745 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:07,745 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:07,745 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,745 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,745 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:07,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:07,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:07,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:54:07,746 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:07,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:07,746 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:07,847 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:07,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:07,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:07,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:07,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,857 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:07,857 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:07,858 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:07,858 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:07,859 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,859 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,861 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,861 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:07,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:07,862 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:07,862 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,863 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:07,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:07,864 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:07,864 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:07,864 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:54:08,286 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112808ddd96b140d4ca69ad1758b4b36b68f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112808ddd96b140d4ca69ad1758b4b36b68f 2023-11-01 09:54:08,296 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/2186cc2cfd484bf8bec61541329e9ea3 2023-11-01 09:54:08,303 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/2186cc2cfd484bf8bec61541329e9ea3 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/2186cc2cfd484bf8bec61541329e9ea3 2023-11-01 09:54:08,309 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/2186cc2cfd484bf8bec61541329e9ea3, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:54:08,310 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 446ms, sequenceid=9, compaction requested=false 2023-11-01 09:54:08,311 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:08,311 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:08,311 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:08,312 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:08,312 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,312 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:08,312 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:08,314 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,314 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:08,314 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:08,314 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:08,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:08,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7feb7bb0[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:08,316 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:08,316 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,318 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:08,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:08,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:08,318 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,318 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:08,319 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,319 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:08,320 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:08,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:08,328 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:08,328 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:08,328 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:08,328 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,328 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:08,331 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,331 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:08,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:08,331 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:08,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:08,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:08,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:08,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,332 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,338 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:08,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:08,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:08,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,354 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:08,354 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,355 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:08,355 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:08,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:08,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:08,456 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:08,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:08,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:08,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:08,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,465 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:08,465 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:08,466 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:08,466 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:08,466 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,466 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,468 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:08,468 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:08,468 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,468 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:08,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:08,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,469 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,469 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:08,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:08,470 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:08,470 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:08,470 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:08,471 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:08,471 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:08,471 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:08,471 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:08,471 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:08,889 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018af16597611d42bfb67a7f5038c3e8ad to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018af16597611d42bfb67a7f5038c3e8ad 2023-11-01 09:54:09,295 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/942dd5690d7440e8841333a51e878471 2023-11-01 09:54:09,302 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/942dd5690d7440e8841333a51e878471 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/942dd5690d7440e8841333a51e878471 2023-11-01 09:54:09,307 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/942dd5690d7440e8841333a51e878471, entries=1, sequenceid=13, filesize=4.9 K 2023-11-01 09:54:09,308 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 837ms, sequenceid=13, compaction requested=true 2023-11-01 09:54:09,308 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:09,308 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:09,308 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:09,309 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:09,309 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,309 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:09,309 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:09,373 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,373 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:09,373 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,373 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:09,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:09,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b4941a7[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:09,375 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:09,375 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:09,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:09,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:09,426 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,426 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:09,488 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:09,488 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,488 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:09,488 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:09,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:09,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:09,491 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:09,491 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:09,491 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:09,491 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,491 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:09,572 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,572 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:09,572 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:09,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:09,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:09,573 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:09,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,574 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,649 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,649 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:09,649 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,649 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:09,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:09,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:09,649 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:09,649 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,649 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:09,650 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:54:09,650 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:09,650 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:09,650 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,650 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:09,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:09,750 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:09,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:09,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:09,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:09,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,761 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:09,761 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:09,762 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:09,762 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:09,762 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,762 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,826 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:09,826 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,827 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:09,827 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:09,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,828 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:09,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:09,829 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:09,829 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:09,829 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:09,829 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:09,843 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205253a45cd7a614bdc84bb9fcd14452ed2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205253a45cd7a614bdc84bb9fcd14452ed2 2023-11-01 09:54:10,255 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/a74dc0988caf465fa347dc0a3c5bc06e 2023-11-01 09:54:10,261 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/a74dc0988caf465fa347dc0a3c5bc06e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/a74dc0988caf465fa347dc0a3c5bc06e 2023-11-01 09:54:10,266 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/a74dc0988caf465fa347dc0a3c5bc06e, entries=1, sequenceid=17, filesize=4.9 K 2023-11-01 09:54:10,267 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 438ms, sequenceid=17, compaction requested=true 2023-11-01 09:54:10,267 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:10,267 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:10,267 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:10,267 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:10,267 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,268 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:10,268 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:10,318 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,318 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:10,319 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,319 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47c20f9a[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:10,320 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:10,320 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:10,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:10,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:10,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:10,365 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:10,365 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:10,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:10,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:10,368 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:10,368 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:10,368 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:10,368 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,368 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:10,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:10,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:10,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:10,396 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,397 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:10,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:10,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:10,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:10,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:10,426 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:10,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:10,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:54:10,427 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:10,428 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:10,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:10,428 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,428 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,428 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,428 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,528 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:10,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:10,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,536 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:10,536 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:10,537 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:10,537 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:10,537 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,537 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,567 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:54:10,572 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,572 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:10,573 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:10,573 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,574 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:10,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:10,574 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:10,574 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:10,574 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:10,575 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:10,575 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:10,575 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:10,990 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122892d40a2c93684c6d968ac82b649c6ba4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122892d40a2c93684c6d968ac82b649c6ba4 2023-11-01 09:54:11,396 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/dc9eb8b8032d494baeef9a6d44854378 2023-11-01 09:54:11,403 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/dc9eb8b8032d494baeef9a6d44854378 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/dc9eb8b8032d494baeef9a6d44854378 2023-11-01 09:54:11,409 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/dc9eb8b8032d494baeef9a6d44854378, entries=1, sequenceid=21, filesize=4.9 K 2023-11-01 09:54:11,411 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 835ms, sequenceid=21, compaction requested=true 2023-11-01 09:54:11,411 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:11,411 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:11,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:11,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:11,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:11,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,413 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:11,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:11,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:11,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@534aa970[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:11,416 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:11,416 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,417 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,417 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:11,417 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:11,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:11,417 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:11,419 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:11,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:11,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:11,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:11,422 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:11,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:11,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:11,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,423 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:11,430 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,430 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:11,430 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:11,431 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,432 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,435 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:11,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:11,436 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:11,436 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,436 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,436 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:11,436 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:11,536 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:11,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:11,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:11,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:11,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,546 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:11,547 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:11,547 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:11,547 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:11,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,549 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,549 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:11,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:11,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:11,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:11,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,552 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:11,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:11,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:11,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:11,553 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:11,553 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:11,553 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:11,553 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:11,553 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:11,553 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:11,553 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:11,554 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:11,970 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231145d6edd589b43bbbcd119b2359c6e67 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231145d6edd589b43bbbcd119b2359c6e67 2023-11-01 09:54:12,376 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/28c711fe7861452c9fa520ef3a399eff 2023-11-01 09:54:12,382 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/28c711fe7861452c9fa520ef3a399eff as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/28c711fe7861452c9fa520ef3a399eff 2023-11-01 09:54:12,387 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/28c711fe7861452c9fa520ef3a399eff, entries=1, sequenceid=25, filesize=4.9 K 2023-11-01 09:54:12,388 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 834ms, sequenceid=25, compaction requested=true 2023-11-01 09:54:12,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:12,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:12,388 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:12,388 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:12,390 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,390 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:12,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:12,390 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,390 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:12,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:12,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77587e52[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:12,392 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:12,392 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,394 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:12,394 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:12,394 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,394 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:12,394 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:12,395 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:12,395 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:12,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,396 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:12,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:12,399 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:12,399 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:12,399 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:12,399 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,399 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:12,400 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,400 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:12,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,400 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:12,401 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,402 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:12,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:12,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:12,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,404 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:12,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:12,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:12,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:12,405 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,405 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,405 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,405 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:12,405 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:12,509 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:12,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:12,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:12,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:12,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,524 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:12,524 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:12,524 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:12,525 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:12,525 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,525 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,528 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:12,528 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:12,528 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,528 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,529 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,529 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:12,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:12,530 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:12,530 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:12,530 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:12,948 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010180e254dc6ac34542b37833ee78568b45 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010180e254dc6ac34542b37833ee78568b45 2023-11-01 09:54:12,960 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/f1e0aea953ad48c0aa31fabf7d9cc740 2023-11-01 09:54:12,966 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/f1e0aea953ad48c0aa31fabf7d9cc740 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/f1e0aea953ad48c0aa31fabf7d9cc740 2023-11-01 09:54:12,970 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/f1e0aea953ad48c0aa31fabf7d9cc740, entries=1, sequenceid=29, filesize=4.9 K 2023-11-01 09:54:12,971 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 441ms, sequenceid=29, compaction requested=true 2023-11-01 09:54:12,971 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:12,972 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:12,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:12,973 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,973 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:12,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:12,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@761d5d67[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:12,975 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:12,975 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,976 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:12,977 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,977 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:12,978 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:12,978 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,978 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:12,978 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:12,981 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:12,981 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:12,981 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:12,981 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,981 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:12,983 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,983 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:12,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,983 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:12,984 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,985 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:12,987 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:12,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:12,987 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,988 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:12,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:12,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:54:12,989 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:12,989 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:13,089 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:13,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:13,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:13,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:13,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,098 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:13,098 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:13,099 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:13,099 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:13,099 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,099 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,101 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,101 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:13,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:13,101 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,101 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:13,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:13,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:13,104 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:13,104 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:13,104 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:13,518 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030a056f275ada46bc81d9f69657def3a6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030a056f275ada46bc81d9f69657def3a6 2023-11-01 09:54:13,924 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/4b5e7b744977443d998434c202a82bda 2023-11-01 09:54:13,931 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/4b5e7b744977443d998434c202a82bda as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4b5e7b744977443d998434c202a82bda 2023-11-01 09:54:13,937 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4b5e7b744977443d998434c202a82bda, entries=1, sequenceid=33, filesize=4.9 K 2023-11-01 09:54:13,938 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 834ms, sequenceid=33, compaction requested=true 2023-11-01 09:54:13,938 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:13,938 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:13,938 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:13,938 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:13,938 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:13,940 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,940 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:13,941 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,941 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:13,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:13,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:13,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:13,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21f422e1[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:13,942 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:13,942 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,945 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,945 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:13,945 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:13,945 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:13,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:13,952 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,952 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:13,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:13,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:13,952 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:13,952 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:13,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:13,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:13,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:13,957 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:13,957 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:13,957 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:13,957 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,957 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:13,959 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,959 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:13,959 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:13,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,960 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:13,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:13,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,961 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:13,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:13,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:13,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:13,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:13,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:13,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:13,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:13,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:13,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:13,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:13,966 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:13,967 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:13,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:54:14,067 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:14,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:14,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:14,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:14,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,076 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:14,076 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:14,077 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:14,077 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:14,077 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,077 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,078 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,078 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:14,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:14,079 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,079 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,080 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,080 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:14,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,080 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:14,080 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:14,080 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:14,081 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:14,081 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:14,081 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:14,081 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:14,081 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:14,497 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090717fdae1f9eda4049a0e429e5515390d6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090717fdae1f9eda4049a0e429e5515390d6 2023-11-01 09:54:14,909 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/e39d3322c41c488d8e128723df9adaac 2023-11-01 09:54:14,917 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/e39d3322c41c488d8e128723df9adaac as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/e39d3322c41c488d8e128723df9adaac 2023-11-01 09:54:14,929 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/e39d3322c41c488d8e128723df9adaac, entries=1, sequenceid=37, filesize=4.9 K 2023-11-01 09:54:14,930 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 849ms, sequenceid=37, compaction requested=true 2023-11-01 09:54:14,930 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:14,930 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:14,931 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,931 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:14,931 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,932 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:14,933 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,933 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:14,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:14,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27731e86[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:14,935 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:14,935 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,937 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,937 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:14,937 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:14,937 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:14,937 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,937 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:14,940 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:14,940 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,940 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:14,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:14,940 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:14,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:14,945 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:14,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:14,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:14,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,945 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:14,947 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,947 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:14,947 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:14,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:14,948 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,950 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:14,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:54:14,955 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:14,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:14,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:14,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:14,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:14,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:14,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:14,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:14,956 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:14,956 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:15,056 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:15,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:15,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,064 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:15,064 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:15,065 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:54:15,065 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:15,066 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,066 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,067 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:15,067 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:15,067 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,067 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,068 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:54:15,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:54:15,068 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:15,070 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:54:15,070 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:15,070 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:15,070 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:15,070 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. started... 2023-11-01 09:54:15,070 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 70058c73ccbece118d377978f7fa6427 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:15,485 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200e80c06928d84759b63663ef0b71c071 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200e80c06928d84759b63663ef0b71c071 2023-11-01 09:54:15,891 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/b7339c964da04df38091ee347cd49a17 2023-11-01 09:54:15,898 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/b7339c964da04df38091ee347cd49a17 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/b7339c964da04df38091ee347cd49a17 2023-11-01 09:54:15,903 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/b7339c964da04df38091ee347cd49a17, entries=1, sequenceid=41, filesize=4.9 K 2023-11-01 09:54:15,904 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 70058c73ccbece118d377978f7fa6427 in 834ms, sequenceid=41, compaction requested=true 2023-11-01 09:54:15,904 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:15,905 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:54:15,905 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:54:15,908 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,908 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:15,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:54:15,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13ed5ed4[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:15,909 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:15,909 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,910 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:54:15,911 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:15,911 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,911 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:54:15,912 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:54:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:15,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:15,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:15,915 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:54:15,915 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:15,915 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:15,915 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,915 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:15,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:15,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:15,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:15,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:15,917 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,918 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:15,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:15,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-01 09:54:15,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:15,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,921 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:15,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:15,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:15,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:15,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:15,922 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:15,923 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:15,923 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:15,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:15,923 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:15,923 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:16,023 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:16,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:16,026 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-01 09:54:16,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:16,029 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:16,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:16,030 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833056030 2023-11-01 09:54:16,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:54:16,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-01 09:54:16,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:16,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x6db52bea to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:16,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67663b87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:16,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:16,088 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035ed261bf1c6f46348b168a13d9b8da6a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601035ed261bf1c6f46348b168a13d9b8da6a 2023-11-01 09:54:16,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:16,108 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:16,109 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:16,117 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:16,118 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:16,129 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ac62d92aa5294648b43235caffc7c839 first=Optional[r5] last=Optional[r6] 2023-11-01 09:54:16,130 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ac62d92aa5294648b43235caffc7c839}] 2023-11-01 09:54:16,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ac62d92aa5294648b43235caffc7c839 for inclusion in 70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:16,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-01 09:54:16,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:16,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:16,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ac62d92aa5294648b43235caffc7c839 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii61kai3cg0apip3b4cqkgnf8ff94keua37dggfl6ud5guipm1hrs9o5ocuirpfq/family1/ac62d92aa5294648b43235caffc7c839 2023-11-01 09:54:16,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii61kai3cg0apip3b4cqkgnf8ff94keua37dggfl6ud5guipm1hrs9o5ocuirpfq/family1/ac62d92aa5294648b43235caffc7c839 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_ 2023-11-01 09:54:16,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii61kai3cg0apip3b4cqkgnf8ff94keua37dggfl6ud5guipm1hrs9o5ocuirpfq/family1/ac62d92aa5294648b43235caffc7c839 into 70058c73ccbece118d377978f7fa6427/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_ - updating store file list. 2023-11-01 09:54:16,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_ into 70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:16,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii61kai3cg0apip3b4cqkgnf8ff94keua37dggfl6ud5guipm1hrs9o5ocuirpfq/family1/ac62d92aa5294648b43235caffc7c839 into 70058c73ccbece118d377978f7fa6427/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_) 2023-11-01 09:54:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii61kai3cg0apip3b4cqkgnf8ff94keua37dggfl6ud5guipm1hrs9o5ocuirpfq/family1/ac62d92aa5294648b43235caffc7c839 2023-11-01 09:54:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:54:16,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:54:16,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 70058c73ccbece118d377978f7fa6427/family1 is initiating minor compaction 2023-11-01 09:54:16,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@491c0955; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:16,157 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 70058c73ccbece118d377978f7fa6427/family1 in testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:16,158 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/2186cc2cfd484bf8bec61541329e9ea3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/942dd5690d7440e8841333a51e878471, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/a74dc0988caf465fa347dc0a3c5bc06e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/dc9eb8b8032d494baeef9a6d44854378, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/28c711fe7861452c9fa520ef3a399eff, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/f1e0aea953ad48c0aa31fabf7d9cc740, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4b5e7b744977443d998434c202a82bda, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/e39d3322c41c488d8e128723df9adaac, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/b7339c964da04df38091ee347cd49a17, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp, totalSize=49.7 K 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 2186cc2cfd484bf8bec61541329e9ea3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 942dd5690d7440e8841333a51e878471, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting a74dc0988caf465fa347dc0a3c5bc06e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting dc9eb8b8032d494baeef9a6d44854378, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 28c711fe7861452c9fa520ef3a399eff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting f1e0aea953ad48c0aa31fabf7d9cc740, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 4b5e7b744977443d998434c202a82bda, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting e39d3322c41c488d8e128723df9adaac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting b7339c964da04df38091ee347cd49a17, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:54:16,158 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:54:16,161 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:16,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:16,166 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010180e254dc6ac34542b37833ee78568b45 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010180e254dc6ac34542b37833ee78568b45 2023-11-01 09:54:16,168 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030a056f275ada46bc81d9f69657def3a6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030a056f275ada46bc81d9f69657def3a6 2023-11-01 09:54:16,168 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-01 09:54:16,168 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-01 09:54:16,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:16,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:16,241 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 70058c73ccbece118d377978f7fa6427#family1#compaction#22 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:16,681 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/03ec61fdf0494457b9a3190d12f0966a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/03ec61fdf0494457b9a3190d12f0966a 2023-11-01 09:54:16,693 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 70058c73ccbece118d377978f7fa6427/family1 of 70058c73ccbece118d377978f7fa6427 into 03ec61fdf0494457b9a3190d12f0966a(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:16,693 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:16,693 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698832456157; duration=0sec 2023-11-01 09:54:16,693 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:16,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/2186cc2cfd484bf8bec61541329e9ea3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/942dd5690d7440e8841333a51e878471, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/a74dc0988caf465fa347dc0a3c5bc06e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/dc9eb8b8032d494baeef9a6d44854378, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/28c711fe7861452c9fa520ef3a399eff, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/f1e0aea953ad48c0aa31fabf7d9cc740, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4b5e7b744977443d998434c202a82bda, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/e39d3322c41c488d8e128723df9adaac, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/b7339c964da04df38091ee347cd49a17, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_] to archive 2023-11-01 09:54:16,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:16,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/2186cc2cfd484bf8bec61541329e9ea3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/2186cc2cfd484bf8bec61541329e9ea3 2023-11-01 09:54:16,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/942dd5690d7440e8841333a51e878471 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/942dd5690d7440e8841333a51e878471 2023-11-01 09:54:16,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/a74dc0988caf465fa347dc0a3c5bc06e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/a74dc0988caf465fa347dc0a3c5bc06e 2023-11-01 09:54:16,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/dc9eb8b8032d494baeef9a6d44854378 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/dc9eb8b8032d494baeef9a6d44854378 2023-11-01 09:54:16,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/28c711fe7861452c9fa520ef3a399eff to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/28c711fe7861452c9fa520ef3a399eff 2023-11-01 09:54:16,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/f1e0aea953ad48c0aa31fabf7d9cc740 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/f1e0aea953ad48c0aa31fabf7d9cc740 2023-11-01 09:54:16,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4b5e7b744977443d998434c202a82bda to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4b5e7b744977443d998434c202a82bda 2023-11-01 09:54:16,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/e39d3322c41c488d8e128723df9adaac to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/e39d3322c41c488d8e128723df9adaac 2023-11-01 09:54:16,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/b7339c964da04df38091ee347cd49a17 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/b7339c964da04df38091ee347cd49a17 2023-11-01 09:54:16,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a26df47022e4d48960a9ab3fd73dc10_SeqId_44_ 2023-11-01 09:54:17,081 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312b4de469a90849b89ecaf8477b0ff646 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312b4de469a90849b89ecaf8477b0ff646 2023-11-01 09:54:17,082 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:17,114 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1258a508850c47359a22c02982d445b6 first=Optional[r1] last=Optional[r4] 2023-11-01 09:54:17,115 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1258a508850c47359a22c02982d445b6}] 2023-11-01 09:54:17,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1258a508850c47359a22c02982d445b6 for inclusion in 70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:17,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-01 09:54:17,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:17,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:17,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1258a508850c47359a22c02982d445b6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u3kc7kga6ntfqnp3g5i9tk0koi1794i1d79buraokhoke67v0l8teq34ck6hufqn/family1/1258a508850c47359a22c02982d445b6 2023-11-01 09:54:17,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u3kc7kga6ntfqnp3g5i9tk0koi1794i1d79buraokhoke67v0l8teq34ck6hufqn/family1/1258a508850c47359a22c02982d445b6 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_ 2023-11-01 09:54:17,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u3kc7kga6ntfqnp3g5i9tk0koi1794i1d79buraokhoke67v0l8teq34ck6hufqn/family1/1258a508850c47359a22c02982d445b6 into 70058c73ccbece118d377978f7fa6427/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_ - updating store file list. 2023-11-01 09:54:17,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_ into 70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:17,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u3kc7kga6ntfqnp3g5i9tk0koi1794i1d79buraokhoke67v0l8teq34ck6hufqn/family1/1258a508850c47359a22c02982d445b6 into 70058c73ccbece118d377978f7fa6427/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_) 2023-11-01 09:54:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u3kc7kga6ntfqnp3g5i9tk0koi1794i1d79buraokhoke67v0l8teq34ck6hufqn/family1/1258a508850c47359a22c02982d445b6 2023-11-01 09:54:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:54:17,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:54:17,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 70058c73ccbece118d377978f7fa6427/family1 is initiating minor compaction (all files) 2023-11-01 09:54:17,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44afb951; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:17,138 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 70058c73ccbece118d377978f7fa6427/family1 in testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:54:17,138 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4a5a7be00f674ecdab8dfaeb3f381b3c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/03ec61fdf0494457b9a3190d12f0966a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp, totalSize=178.1 K 2023-11-01 09:54:17,139 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 4a5a7be00f674ecdab8dfaeb3f381b3c, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:54:17,139 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 03ec61fdf0494457b9a3190d12f0966a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:54:17,140 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 721730c92c374eeea333844136023958_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965256338 2023-11-01 09:54:17,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:17,141 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:17,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018af16597611d42bfb67a7f5038c3e8ad to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018af16597611d42bfb67a7f5038c3e8ad 2023-11-01 09:54:17,151 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205253a45cd7a614bdc84bb9fcd14452ed2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205253a45cd7a614bdc84bb9fcd14452ed2 2023-11-01 09:54:17,153 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122892d40a2c93684c6d968ac82b649c6ba4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122892d40a2c93684c6d968ac82b649c6ba4 2023-11-01 09:54:17,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231145d6edd589b43bbbcd119b2359c6e67 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231145d6edd589b43bbbcd119b2359c6e67 2023-11-01 09:54:17,155 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-01 09:54:17,155 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-01 09:54:17,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:17,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:17,166 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 70058c73ccbece118d377978f7fa6427#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:17,641 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b28c3fe29d874af5b05a1f5defb3d784 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b28c3fe29d874af5b05a1f5defb3d784 2023-11-01 09:54:17,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:17,668 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc711230787b44fb94909d28e2c7160a first=Optional[r00] last=Optional[r8] 2023-11-01 09:54:17,669 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc711230787b44fb94909d28e2c7160a}] 2023-11-01 09:54:17,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc711230787b44fb94909d28e2c7160a for inclusion in 70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:17,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-01 09:54:17,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:17,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:17,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc711230787b44fb94909d28e2c7160a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__h0iekspjd93pe7lik4g7e55l3q2luca0cd6dd1rlcf3kh2gofc51jst6eu1b6sdu/family1/fc711230787b44fb94909d28e2c7160a 2023-11-01 09:54:17,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__h0iekspjd93pe7lik4g7e55l3q2luca0cd6dd1rlcf3kh2gofc51jst6eu1b6sdu/family1/fc711230787b44fb94909d28e2c7160a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a61ec8acac54d66b9204a4759ad8662_SeqId_49_ 2023-11-01 09:54:17,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__h0iekspjd93pe7lik4g7e55l3q2luca0cd6dd1rlcf3kh2gofc51jst6eu1b6sdu/family1/fc711230787b44fb94909d28e2c7160a into 70058c73ccbece118d377978f7fa6427/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a61ec8acac54d66b9204a4759ad8662_SeqId_49_ - updating store file list. 2023-11-01 09:54:17,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a61ec8acac54d66b9204a4759ad8662_SeqId_49_ into 70058c73ccbece118d377978f7fa6427/family1 2023-11-01 09:54:17,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__h0iekspjd93pe7lik4g7e55l3q2luca0cd6dd1rlcf3kh2gofc51jst6eu1b6sdu/family1/fc711230787b44fb94909d28e2c7160a into 70058c73ccbece118d377978f7fa6427/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/8a61ec8acac54d66b9204a4759ad8662_SeqId_49_) 2023-11-01 09:54:17,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithMonthlyPolicy__h0iekspjd93pe7lik4g7e55l3q2luca0cd6dd1rlcf3kh2gofc51jst6eu1b6sdu/family1/fc711230787b44fb94909d28e2c7160a 2023-11-01 09:54:17,685 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:17,686 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:17,687 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200e80c06928d84759b63663ef0b71c071 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200e80c06928d84759b63663ef0b71c071 2023-11-01 09:54:17,688 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112808ddd96b140d4ca69ad1758b4b36b68f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112808ddd96b140d4ca69ad1758b4b36b68f 2023-11-01 09:54:17,689 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113016d8b9d802864375a75faf3201d2613b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113016d8b9d802864375a75faf3201d2613b 2023-11-01 09:54:17,689 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-01 09:54:17,689 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-01 09:54:17,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:17,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:17,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:54:17,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:54:17,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:17,691 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:17,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.6640 sec 2023-11-01 09:54:17,791 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=260 (was 244) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39362 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6db2e1d0-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/ee4f335cc0db4b2399de89c641acd504 block BP-1579401383-172.31.14.131-1698832428297:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x6db2e1d0-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39250 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6db2e1d0-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39286 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39420 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39280 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6db2e1d0-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39378 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39300 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39332 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1579401383-172.31.14.131-1698832428297:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6db2e1d0-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39490 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58138 [Waiting for operation #28] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49762@0x6db52bea-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:58022 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130119562_17 at /127.0.0.1:39506 [Receiving block BP-1579401383-172.31.14.131-1698832428297:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39338 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39432 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319ebb23d241884c789d2e19bc4be09f31 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130119562_17 at /127.0.0.1:39478 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5fd5903c-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39340 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39390 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49762@0x6db52bea sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/719220859.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6db2e1d0-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6db2e1d0-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-1579401383-172.31.14.131-1698832428297:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1628353877_17 at /127.0.0.1:39374 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49762@0x6db52bea-SendThread(127.0.0.1:49762) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) - Thread LEAK? -, OpenFileDescriptor=614 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=10935 (was 11168) 2023-11-01 09:54:17,802 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=169, AvailableMemoryMB=10935 2023-11-01 09:54:17,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-01 09:54:17,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:17,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:54:17,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-01 09:54:17,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:54:17,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-01 09:54:17,809 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:17,810 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c empty. 2023-11-01 09:54:17,810 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:17,810 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-01 09:54:17,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-01 09:54:18,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-01 09:54:18,220 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:18,222 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1388645b6ecdeccc3d9fbf68cdb7b63c, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:18,411 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/.tmp/family1/ee4f335cc0db4b2399de89c641acd504 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/ee4f335cc0db4b2399de89c641acd504 2023-11-01 09:54:18,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-01 09:54:18,424 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 70058c73ccbece118d377978f7fa6427/family1 of 70058c73ccbece118d377978f7fa6427 into ee4f335cc0db4b2399de89c641acd504(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:54:18,425 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:54:18,425 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698832457137; duration=1sec 2023-11-01 09:54:18,425 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:18,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4a5a7be00f674ecdab8dfaeb3f381b3c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/03ec61fdf0494457b9a3190d12f0966a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_] to archive 2023-11-01 09:54:18,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:18,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4a5a7be00f674ecdab8dfaeb3f381b3c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/4a5a7be00f674ecdab8dfaeb3f381b3c 2023-11-01 09:54:18,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/03ec61fdf0494457b9a3190d12f0966a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/03ec61fdf0494457b9a3190d12f0966a 2023-11-01 09:54:18,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/family1/721730c92c374eeea333844136023958_SeqId_47_ 2023-11-01 09:54:18,628 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:18,628 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 1388645b6ecdeccc3d9fbf68cdb7b63c, disabling compactions & flushes 2023-11-01 09:54:18,628 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,628 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,628 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. after waiting 0 ms 2023-11-01 09:54:18,628 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,628 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,628 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:18,631 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:54:18,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698832458632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832458632"}]},"ts":"1698832458632"} 2023-11-01 09:54:18,634 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:54:18,634 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:54:18,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832458635"}]},"ts":"1698832458635"} 2023-11-01 09:54:18,636 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-01 09:54:18,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1388645b6ecdeccc3d9fbf68cdb7b63c, ASSIGN}] 2023-11-01 09:54:18,643 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1388645b6ecdeccc3d9fbf68cdb7b63c, ASSIGN 2023-11-01 09:54:18,644 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1388645b6ecdeccc3d9fbf68cdb7b63c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:18,795 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1388645b6ecdeccc3d9fbf68cdb7b63c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:18,796 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698832458795"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832458795"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832458795"}]},"ts":"1698832458795"} 2023-11-01 09:54:18,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 1388645b6ecdeccc3d9fbf68cdb7b63c, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:18,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-01 09:54:18,950 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:18,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1388645b6ecdeccc3d9fbf68cdb7b63c, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:54:18,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:18,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,955 INFO [StoreOpener-1388645b6ecdeccc3d9fbf68cdb7b63c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,956 DEBUG [StoreOpener-1388645b6ecdeccc3d9fbf68cdb7b63c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1 2023-11-01 09:54:18,956 DEBUG [StoreOpener-1388645b6ecdeccc3d9fbf68cdb7b63c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1 2023-11-01 09:54:18,956 INFO [StoreOpener-1388645b6ecdeccc3d9fbf68cdb7b63c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1388645b6ecdeccc3d9fbf68cdb7b63c columnFamilyName family1 2023-11-01 09:54:18,958 INFO [StoreOpener-1388645b6ecdeccc3d9fbf68cdb7b63c-1] regionserver.HStore(310): Store=1388645b6ecdeccc3d9fbf68cdb7b63c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:18,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:54:18,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:18,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1388645b6ecdeccc3d9fbf68cdb7b63c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71430368, jitterRate=0.06439542770385742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:54:18,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:18,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c., pid=25, masterSystemTime=1698832458950 2023-11-01 09:54:18,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:18,967 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1388645b6ecdeccc3d9fbf68cdb7b63c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:18,968 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698832458967"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832458967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832458967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832458967"}]},"ts":"1698832458967"} 2023-11-01 09:54:18,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-01 09:54:18,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 1388645b6ecdeccc3d9fbf68cdb7b63c, server=jenkins-hbase4.apache.org,40233,1698832432817 in 171 msec 2023-11-01 09:54:18,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-01 09:54:18,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1388645b6ecdeccc3d9fbf68cdb7b63c, ASSIGN in 329 msec 2023-11-01 09:54:18,973 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:54:18,974 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832458973"}]},"ts":"1698832458973"} 2023-11-01 09:54:18,975 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-01 09:54:18,983 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:54:18,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1790 sec 2023-11-01 09:54:19,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-01 09:54:19,914 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-01 09:54:19,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:19,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,952 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:19,952 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:19,953 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:19,953 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:19,953 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,954 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:19,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:19,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:19,955 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:19,956 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:19,956 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,963 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:19,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:19,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:19,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:19,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:19,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:19,964 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:19,964 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:19,965 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:54:19,996 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130515cd4dbdc7e46538360156a09466de1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130515cd4dbdc7e46538360156a09466de1 2023-11-01 09:54:20,403 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/761c64b796a14def9863b9465e2bf30f 2023-11-01 09:54:20,410 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/761c64b796a14def9863b9465e2bf30f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/761c64b796a14def9863b9465e2bf30f 2023-11-01 09:54:20,416 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/761c64b796a14def9863b9465e2bf30f, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-01 09:54:20,417 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 452ms, sequenceid=5, compaction requested=false 2023-11-01 09:54:20,417 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:20,418 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:20,418 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:20,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:20,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:20,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:20,418 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:20,420 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,420 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:20,420 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,420 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f07cfab[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:20,422 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:20,422 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,423 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,423 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:20,423 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:20,423 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:20,424 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,424 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:20,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:20,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:20,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:20,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:20,430 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:20,430 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:20,430 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:20,430 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,430 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:20,432 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,432 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:20,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,432 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,432 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:20,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,434 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:20,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,437 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:20,437 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,438 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:20,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:20,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:20,438 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:20,438 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:20,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:20,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:20,538 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:20,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:20,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:20,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:20,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,550 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:20,550 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:20,550 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:20,551 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:20,552 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,552 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,554 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,554 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:20,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:20,555 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:20,555 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,556 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,556 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:20,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:20,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:20,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:20,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:20,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:20,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:20,557 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:20,557 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:20,557 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:54:20,980 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281089cb285c4e46d680e317200d6fefda to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511281089cb285c4e46d680e317200d6fefda 2023-11-01 09:54:21,387 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/7f56125523174c26a5c99db0ebcbf7ae 2023-11-01 09:54:21,395 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/7f56125523174c26a5c99db0ebcbf7ae as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/7f56125523174c26a5c99db0ebcbf7ae 2023-11-01 09:54:21,403 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/7f56125523174c26a5c99db0ebcbf7ae, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:54:21,404 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 847ms, sequenceid=9, compaction requested=false 2023-11-01 09:54:21,404 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:21,405 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:21,409 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,409 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:21,410 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,410 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:21,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:21,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fe40780[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:21,412 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:21,412 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,413 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:21,413 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,413 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:21,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:21,414 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:21,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:21,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:21,417 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:21,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:21,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:21,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,417 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:21,419 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,419 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,419 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:21,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:21,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:21,419 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,421 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:21,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:21,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:21,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:21,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:21,424 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:21,425 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:21,424 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,425 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:21,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:21,525 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:21,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:21,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:21,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:21,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,532 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:21,532 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:21,532 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:21,532 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:21,532 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,532 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,533 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,533 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:21,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:21,534 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:21,534 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:21,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,535 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:21,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:21,535 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:21,535 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:21,535 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:21,535 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:21,535 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:21,535 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:21,535 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:21,536 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:21,950 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120133fd621c11464bf7b86db82c58bc2a29 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120133fd621c11464bf7b86db82c58bc2a29 2023-11-01 09:54:22,368 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/373ac7b7dfed45d6be81fe161da655af 2023-11-01 09:54:22,374 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/373ac7b7dfed45d6be81fe161da655af as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/373ac7b7dfed45d6be81fe161da655af 2023-11-01 09:54:22,378 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/373ac7b7dfed45d6be81fe161da655af, entries=1, sequenceid=13, filesize=4.9 K 2023-11-01 09:54:22,379 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 843ms, sequenceid=13, compaction requested=true 2023-11-01 09:54:22,379 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:22,380 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:22,380 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:22,380 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:22,380 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,380 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:22,380 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:22,381 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,381 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:22,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:22,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30dcafd4[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:22,383 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:22,384 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,385 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,385 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:22,385 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:22,385 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:22,385 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,385 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:22,386 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:22,389 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:22,389 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:22,389 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:22,389 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,389 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:22,392 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,392 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:22,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,392 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:22,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:22,392 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,393 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,398 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:22,399 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:22,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:22,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:22,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:22,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:22,399 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:22,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:22,499 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:22,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:22,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:22,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:22,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,507 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:22,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:22,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:22,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:22,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,509 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:22,509 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:22,509 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:22,509 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:22,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,510 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,510 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:22,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:22,510 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:22,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:22,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:22,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:22,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:22,511 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:22,511 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:22,511 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:22,929 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120583e6bf4c4dc34f959492af99015169fe to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120583e6bf4c4dc34f959492af99015169fe 2023-11-01 09:54:23,334 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/e1f705985d8645b0a514ed3c0a27f6d1 2023-11-01 09:54:23,340 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/e1f705985d8645b0a514ed3c0a27f6d1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/e1f705985d8645b0a514ed3c0a27f6d1 2023-11-01 09:54:23,345 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/e1f705985d8645b0a514ed3c0a27f6d1, entries=1, sequenceid=17, filesize=4.9 K 2023-11-01 09:54:23,346 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 835ms, sequenceid=17, compaction requested=true 2023-11-01 09:54:23,346 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:23,346 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:23,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,349 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:23,349 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:23,349 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:23,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:23,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49be5ce5[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:23,350 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:23,350 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,352 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:23,352 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,352 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:23,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,353 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:23,353 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:23,353 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:23,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:23,356 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:23,356 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:23,356 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:23,356 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,356 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:23,357 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,357 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:23,357 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:23,358 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,359 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:23,361 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:23,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:23,362 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:23,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:23,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:23,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,362 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,462 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:23,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:23,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:23,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:23,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,470 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:23,470 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:23,470 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:23,470 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:23,470 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,470 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,471 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:23,471 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:23,472 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,472 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:23,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,473 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,473 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:23,474 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:23,474 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:23,475 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:23,475 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:23,475 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:23,475 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:23,475 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:23,896 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ec8a9528c1c4403694355ee1d33ea16e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228ec8a9528c1c4403694355ee1d33ea16e 2023-11-01 09:54:23,905 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/6f96660eba4344108bf6f4642cb2816b 2023-11-01 09:54:23,911 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/6f96660eba4344108bf6f4642cb2816b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/6f96660eba4344108bf6f4642cb2816b 2023-11-01 09:54:23,918 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/6f96660eba4344108bf6f4642cb2816b, entries=1, sequenceid=21, filesize=4.9 K 2023-11-01 09:54:23,919 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 444ms, sequenceid=21, compaction requested=true 2023-11-01 09:54:23,919 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:23,919 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:23,919 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:23,921 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,921 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:23,921 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,921 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:23,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:23,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78f5a8ee[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:23,923 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:23,923 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,924 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,924 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:23,924 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:23,924 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:23,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:23,927 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:23,927 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,927 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:23,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:23,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:23,927 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:23,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:23,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:23,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:23,929 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:23,929 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:23,929 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:23,929 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,929 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:23,931 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,931 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:23,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,931 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:23,931 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,932 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:23,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,934 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,934 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,935 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:23,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:23,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:23,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:23,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:23,935 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:23,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:23,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:24,035 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:24,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:24,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:24,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:24,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,043 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:24,043 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:24,043 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:24,043 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:24,044 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,044 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,045 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,045 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:24,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:24,045 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,045 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,047 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:24,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,047 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:24,047 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:24,047 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:24,048 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:24,048 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:24,048 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:24,048 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:24,048 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:24,464 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311710066d123f4ca381e5a3e9e37ff936 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512311710066d123f4ca381e5a3e9e37ff936 2023-11-01 09:54:24,483 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:54:24,870 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/81d705eaa2bc4dbf8dbef5aa07e3e646 2023-11-01 09:54:24,876 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/81d705eaa2bc4dbf8dbef5aa07e3e646 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/81d705eaa2bc4dbf8dbef5aa07e3e646 2023-11-01 09:54:24,881 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/81d705eaa2bc4dbf8dbef5aa07e3e646, entries=1, sequenceid=25, filesize=4.9 K 2023-11-01 09:54:24,882 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 834ms, sequenceid=25, compaction requested=true 2023-11-01 09:54:24,882 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:24,882 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:24,882 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:24,882 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:24,882 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,882 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:24,882 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:24,885 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,885 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:24,885 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,885 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:24,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:24,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:24,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:24,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57026877[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:24,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:24,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,888 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,888 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:24,888 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:24,888 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:24,888 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,888 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:24,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:24,892 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:24,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:24,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:24,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:24,894 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:24,894 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:24,894 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:24,894 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,895 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:24,897 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,897 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:24,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,898 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,898 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:24,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,899 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:24,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:24,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:24,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:24,901 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:24,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:24,902 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:24,901 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,902 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:24,902 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,902 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:24,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:25,002 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:25,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:25,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:25,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:25,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,009 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:25,009 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:25,009 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:25,009 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:25,010 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,010 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,011 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,011 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:25,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:25,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:25,012 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,012 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:25,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,012 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,013 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:25,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,013 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:25,013 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:25,013 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:25,013 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:25,013 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:25,013 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:25,013 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:25,013 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:25,426 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012931e651f3b04cadafb8fc3888dfe69b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012931e651f3b04cadafb8fc3888dfe69b 2023-11-01 09:54:25,832 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/20382690c02f42beb77b154f90758306 2023-11-01 09:54:25,838 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/20382690c02f42beb77b154f90758306 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/20382690c02f42beb77b154f90758306 2023-11-01 09:54:25,842 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/20382690c02f42beb77b154f90758306, entries=1, sequenceid=29, filesize=4.9 K 2023-11-01 09:54:25,843 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 830ms, sequenceid=29, compaction requested=true 2023-11-01 09:54:25,843 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:25,843 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:25,845 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,845 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:25,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:25,845 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,845 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:25,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:25,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:25,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:25,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:25,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5df4c[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:25,846 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:25,847 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,848 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:25,849 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,849 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:25,850 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:25,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:25,852 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:25,852 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:25,852 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:25,852 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,852 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:25,854 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,854 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,854 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:25,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:25,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:25,854 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,855 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:25,857 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:25,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:25,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:25,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:25,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:25,858 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,858 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,858 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:25,858 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:25,858 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:25,858 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:25,958 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:25,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:25,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:25,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:25,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,967 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:25,967 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:25,967 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:25,967 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:25,967 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,968 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,970 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:25,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:25,970 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,971 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:25,971 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:25,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,972 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:25,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:25,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:25,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:25,972 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:25,973 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:25,973 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:25,973 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:26,395 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103979341793b5842ce8fb151f4e7c990aa to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103979341793b5842ce8fb151f4e7c990aa 2023-11-01 09:54:26,801 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/304dbcc1eefe4a28927adc95ff576cc0 2023-11-01 09:54:26,806 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/304dbcc1eefe4a28927adc95ff576cc0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/304dbcc1eefe4a28927adc95ff576cc0 2023-11-01 09:54:26,811 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/304dbcc1eefe4a28927adc95ff576cc0, entries=1, sequenceid=33, filesize=4.9 K 2023-11-01 09:54:26,812 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 839ms, sequenceid=33, compaction requested=true 2023-11-01 09:54:26,812 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:26,812 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:26,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:26,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:26,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:26,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:26,813 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,814 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:26,814 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,814 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:26,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:26,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:26,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3997e283[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:26,815 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:26,815 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,817 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:26,817 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:26,817 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:26,817 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,817 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:26,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:26,818 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:26,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:26,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:26,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:26,820 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:26,820 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:26,820 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:26,820 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,820 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:26,827 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,827 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,827 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:26,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:26,828 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:26,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,829 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:26,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,831 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,831 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:26,831 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:26,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:26,831 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:26,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:26,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:26,831 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:26,831 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:26,832 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,832 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:26,832 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,832 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:26,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:26,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:26,832 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,832 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,932 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:26,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:26,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:26,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:26,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,938 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:26,938 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:26,938 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:26,938 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:26,939 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,939 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,940 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:26,940 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:26,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:26,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,941 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,942 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:26,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:26,942 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:26,942 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:26,942 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:27,355 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079de5689b25b74679b8421a2fd1cbd9e9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509079de5689b25b74679b8421a2fd1cbd9e9 2023-11-01 09:54:27,761 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/d55d35748da440ffa882fff2ee572c02 2023-11-01 09:54:27,767 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/d55d35748da440ffa882fff2ee572c02 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/d55d35748da440ffa882fff2ee572c02 2023-11-01 09:54:27,772 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/d55d35748da440ffa882fff2ee572c02, entries=1, sequenceid=37, filesize=4.9 K 2023-11-01 09:54:27,773 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 831ms, sequenceid=37, compaction requested=true 2023-11-01 09:54:27,773 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:27,773 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:27,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:27,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:27,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:27,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:27,774 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,774 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:27,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:27,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:27,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c709f87[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:27,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:27,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,782 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,782 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:27,782 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:27,782 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:27,782 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,782 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:27,785 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,785 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:27,785 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:27,785 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:27,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:27,788 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:27,788 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:27,788 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:27,788 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,788 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:27,790 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,790 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:27,790 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:27,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,792 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:27,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,796 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:27,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:27,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:27,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:27,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:27,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:27,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:27,796 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:27,897 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:27,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:27,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:27,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:27,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,903 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:27,903 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:27,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:27,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:27,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,905 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,905 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:27,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:27,906 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:27,906 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:27,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:27,907 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:27,907 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. started... 2023-11-01 09:54:27,907 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1388645b6ecdeccc3d9fbf68cdb7b63c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:27,920 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201113c710e0554d6e83b533919526ba8d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511201113c710e0554d6e83b533919526ba8d 2023-11-01 09:54:28,326 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/1012213bd4b14ca1afb9734f5b4a920d 2023-11-01 09:54:28,332 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/1012213bd4b14ca1afb9734f5b4a920d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1012213bd4b14ca1afb9734f5b4a920d 2023-11-01 09:54:28,336 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1012213bd4b14ca1afb9734f5b4a920d, entries=1, sequenceid=41, filesize=4.9 K 2023-11-01 09:54:28,337 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1388645b6ecdeccc3d9fbf68cdb7b63c in 430ms, sequenceid=41, compaction requested=true 2023-11-01 09:54:28,338 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:28,338 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:28,339 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:28,340 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,340 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:28,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:28,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28f513ae[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:28,341 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:28,341 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:28,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:28,345 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:28,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:28,347 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:28,348 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:28,348 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:28,348 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,348 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:28,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:28,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:28,350 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,351 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,353 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-01 09:54:28,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:28,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:28,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:28,353 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,454 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:28,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:28,456 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-01 09:54:28,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:28,458 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:28,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:28,459 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833068459 2023-11-01 09:54:28,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-01 09:54:28,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-01 09:54:28,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:28,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x6e8849f1 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:28,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38e4eda4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:28,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,306 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fef38ab5f8994c398d212061c6526cbe to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fef38ab5f8994c398d212061c6526cbe 2023-11-01 09:54:29,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:29,320 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:29,321 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:29,327 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:29,329 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:29,337 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b57ea617c850416fb47358a8c8833224 first=Optional[r3] last=Optional[r6] 2023-11-01 09:54:29,338 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b57ea617c850416fb47358a8c8833224}] 2023-11-01 09:54:29,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b57ea617c850416fb47358a8c8833224 for inclusion in 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 2023-11-01 09:54:29,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-01 09:54:29,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:29,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b57ea617c850416fb47358a8c8833224 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f39lm8grnsldsevho3fomumak4fr5e1e0ltfe9fn5dvv4aau2f95rao2qdr8qohl/family1/b57ea617c850416fb47358a8c8833224 2023-11-01 09:54:29,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f39lm8grnsldsevho3fomumak4fr5e1e0ltfe9fn5dvv4aau2f95rao2qdr8qohl/family1/b57ea617c850416fb47358a8c8833224 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_ 2023-11-01 09:54:29,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f39lm8grnsldsevho3fomumak4fr5e1e0ltfe9fn5dvv4aau2f95rao2qdr8qohl/family1/b57ea617c850416fb47358a8c8833224 into 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_ - updating store file list. 2023-11-01 09:54:29,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_ into 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 2023-11-01 09:54:29,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f39lm8grnsldsevho3fomumak4fr5e1e0ltfe9fn5dvv4aau2f95rao2qdr8qohl/family1/b57ea617c850416fb47358a8c8833224 into 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_) 2023-11-01 09:54:29,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f39lm8grnsldsevho3fomumak4fr5e1e0ltfe9fn5dvv4aau2f95rao2qdr8qohl/family1/b57ea617c850416fb47358a8c8833224 2023-11-01 09:54:29,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:54:29,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:54:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 is initiating minor compaction 2023-11-01 09:54:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@56c196a5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:29,358 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 in testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:29,358 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/7f56125523174c26a5c99db0ebcbf7ae, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/373ac7b7dfed45d6be81fe161da655af, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/e1f705985d8645b0a514ed3c0a27f6d1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/6f96660eba4344108bf6f4642cb2816b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/81d705eaa2bc4dbf8dbef5aa07e3e646, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/20382690c02f42beb77b154f90758306, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/304dbcc1eefe4a28927adc95ff576cc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/d55d35748da440ffa882fff2ee572c02, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1012213bd4b14ca1afb9734f5b4a920d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp, totalSize=50.0 K 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 7f56125523174c26a5c99db0ebcbf7ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 373ac7b7dfed45d6be81fe161da655af, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting e1f705985d8645b0a514ed3c0a27f6d1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 6f96660eba4344108bf6f4642cb2816b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 81d705eaa2bc4dbf8dbef5aa07e3e646, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 20382690c02f42beb77b154f90758306, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 304dbcc1eefe4a28927adc95ff576cc0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting d55d35748da440ffa882fff2ee572c02, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:54:29,358 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 1012213bd4b14ca1afb9734f5b4a920d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:54:29,359 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:54:29,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:29,361 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:29,362 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228ec8a9528c1c4403694355ee1d33ea16e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228ec8a9528c1c4403694355ee1d33ea16e 2023-11-01 09:54:29,364 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512311710066d123f4ca381e5a3e9e37ff936 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512311710066d123f4ca381e5a3e9e37ff936 2023-11-01 09:54:29,365 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012931e651f3b04cadafb8fc3888dfe69b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012931e651f3b04cadafb8fc3888dfe69b 2023-11-01 09:54:29,367 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103979341793b5842ce8fb151f4e7c990aa to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103979341793b5842ce8fb151f4e7c990aa 2023-11-01 09:54:29,367 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-01 09:54:29,367 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:29,397 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1388645b6ecdeccc3d9fbf68cdb7b63c#family1#compaction#34 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:30,206 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120598f81f1b5b9349698bd2d97c5372a78e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120598f81f1b5b9349698bd2d97c5372a78e 2023-11-01 09:54:30,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:30,212 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/24d240e26ee84ac3b6d6355492ccb10f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/24d240e26ee84ac3b6d6355492ccb10f 2023-11-01 09:54:30,218 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 of 1388645b6ecdeccc3d9fbf68cdb7b63c into 24d240e26ee84ac3b6d6355492ccb10f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:30,218 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:30,218 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698832469357; duration=0sec 2023-11-01 09:54:30,218 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:30,235 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/291cd6652b9f499aa6ee158d9c364167 first=Optional[r1] last=Optional[r2] 2023-11-01 09:54:30,236 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/291cd6652b9f499aa6ee158d9c364167}] 2023-11-01 09:54:30,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/291cd6652b9f499aa6ee158d9c364167 for inclusion in 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 2023-11-01 09:54:30,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-01 09:54:30,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:30,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:30,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/291cd6652b9f499aa6ee158d9c364167 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ohd0ngvc4fms75hkf1opitct0tet1ehmf2e70sg3cesga7a6d4koartgd23kb7m/family1/291cd6652b9f499aa6ee158d9c364167 2023-11-01 09:54:30,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/7f56125523174c26a5c99db0ebcbf7ae, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/373ac7b7dfed45d6be81fe161da655af, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/e1f705985d8645b0a514ed3c0a27f6d1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/6f96660eba4344108bf6f4642cb2816b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/81d705eaa2bc4dbf8dbef5aa07e3e646, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/20382690c02f42beb77b154f90758306, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/304dbcc1eefe4a28927adc95ff576cc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/d55d35748da440ffa882fff2ee572c02, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1012213bd4b14ca1afb9734f5b4a920d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_] to archive 2023-11-01 09:54:30,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:30,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ohd0ngvc4fms75hkf1opitct0tet1ehmf2e70sg3cesga7a6d4koartgd23kb7m/family1/291cd6652b9f499aa6ee158d9c364167 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_ 2023-11-01 09:54:30,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ohd0ngvc4fms75hkf1opitct0tet1ehmf2e70sg3cesga7a6d4koartgd23kb7m/family1/291cd6652b9f499aa6ee158d9c364167 into 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_ - updating store file list. 2023-11-01 09:54:30,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/7f56125523174c26a5c99db0ebcbf7ae to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/7f56125523174c26a5c99db0ebcbf7ae 2023-11-01 09:54:30,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/373ac7b7dfed45d6be81fe161da655af to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/373ac7b7dfed45d6be81fe161da655af 2023-11-01 09:54:30,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/e1f705985d8645b0a514ed3c0a27f6d1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/e1f705985d8645b0a514ed3c0a27f6d1 2023-11-01 09:54:30,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_ into 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 2023-11-01 09:54:30,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ohd0ngvc4fms75hkf1opitct0tet1ehmf2e70sg3cesga7a6d4koartgd23kb7m/family1/291cd6652b9f499aa6ee158d9c364167 into 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_) 2023-11-01 09:54:30,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/6f96660eba4344108bf6f4642cb2816b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/6f96660eba4344108bf6f4642cb2816b 2023-11-01 09:54:30,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ohd0ngvc4fms75hkf1opitct0tet1ehmf2e70sg3cesga7a6d4koartgd23kb7m/family1/291cd6652b9f499aa6ee158d9c364167 2023-11-01 09:54:30,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:54:30,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/81d705eaa2bc4dbf8dbef5aa07e3e646 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/81d705eaa2bc4dbf8dbef5aa07e3e646 2023-11-01 09:54:30,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:54:30,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 is initiating minor compaction (all files) 2023-11-01 09:54:30,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@54b256b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:30,261 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 in testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:54:30,261 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/761c64b796a14def9863b9465e2bf30f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/24d240e26ee84ac3b6d6355492ccb10f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp, totalSize=176.8 K 2023-11-01 09:54:30,262 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 761c64b796a14def9863b9465e2bf30f, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:54:30,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/20382690c02f42beb77b154f90758306 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/20382690c02f42beb77b154f90758306 2023-11-01 09:54:30,262 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 24d240e26ee84ac3b6d6355492ccb10f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:54:30,263 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting ea4e1ed1db1b44999f715af29a918c98_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965256338 2023-11-01 09:54:30,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:30,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/304dbcc1eefe4a28927adc95ff576cc0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/304dbcc1eefe4a28927adc95ff576cc0 2023-11-01 09:54:30,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:30,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/d55d35748da440ffa882fff2ee572c02 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/d55d35748da440ffa882fff2ee572c02 2023-11-01 09:54:30,265 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120133fd621c11464bf7b86db82c58bc2a29 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120133fd621c11464bf7b86db82c58bc2a29 2023-11-01 09:54:30,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1012213bd4b14ca1afb9734f5b4a920d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1012213bd4b14ca1afb9734f5b4a920d 2023-11-01 09:54:30,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120583e6bf4c4dc34f959492af99015169fe to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120583e6bf4c4dc34f959492af99015169fe 2023-11-01 09:54:30,268 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-01 09:54:30,268 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-01 09:54:30,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:30,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:30,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:30,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/b687a00c3fcd403aa4e78c348f8614f2_SeqId_44_ 2023-11-01 09:54:30,271 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:30,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8150 sec 2023-11-01 09:54:30,281 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1388645b6ecdeccc3d9fbf68cdb7b63c#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:30,378 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258 (was 260), OpenFileDescriptor=608 (was 614), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 341), ProcessCount=169 (was 169), AvailableMemoryMB=10739 (was 10935) 2023-11-01 09:54:30,391 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=258, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=169, AvailableMemoryMB=10738 2023-11-01 09:54:30,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-01 09:54:30,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:30,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:54:30,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-01 09:54:30,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:54:30,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-01 09:54:30,400 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:30,400 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:30,400 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:30,400 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0 empty. 2023-11-01 09:54:30,400 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d empty. 2023-11-01 09:54:30,400 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04 empty. 2023-11-01 09:54:30,401 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:30,401 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:30,401 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:30,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-01 09:54:30,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-01 09:54:30,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-01 09:54:30,811 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:30,813 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3fee1307da01b6d821587a0ba912a96d, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:30,813 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 69910e0ca18b4fdfb4a00f4bd1dc27f0, NAME => 'testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:30,813 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => e2584f1b9fc06508be08e77278378d04, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:30,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:30,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing e2584f1b9fc06508be08e77278378d04, disabling compactions & flushes 2023-11-01 09:54:30,837 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:30,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:30,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. after waiting 0 ms 2023-11-01 09:54:30,838 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:30,838 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:30,838 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:54:31,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-01 09:54:31,227 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:31,227 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 3fee1307da01b6d821587a0ba912a96d, disabling compactions & flushes 2023-11-01 09:54:31,227 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,227 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,227 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. after waiting 0 ms 2023-11-01 09:54:31,227 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,227 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,227 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 3fee1307da01b6d821587a0ba912a96d: 2023-11-01 09:54:31,237 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:31,237 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 69910e0ca18b4fdfb4a00f4bd1dc27f0, disabling compactions & flushes 2023-11-01 09:54:31,237 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,237 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,237 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. after waiting 0 ms 2023-11-01 09:54:31,237 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,237 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,237 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 69910e0ca18b4fdfb4a00f4bd1dc27f0: 2023-11-01 09:54:31,239 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:54:31,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698832471240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832471240"}]},"ts":"1698832471240"} 2023-11-01 09:54:31,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698832471240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832471240"}]},"ts":"1698832471240"} 2023-11-01 09:54:31,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698832471240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832471240"}]},"ts":"1698832471240"} 2023-11-01 09:54:31,243 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-01 09:54:31,244 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:54:31,244 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832471244"}]},"ts":"1698832471244"} 2023-11-01 09:54:31,246 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-01 09:54:31,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=69910e0ca18b4fdfb4a00f4bd1dc27f0, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3fee1307da01b6d821587a0ba912a96d, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e2584f1b9fc06508be08e77278378d04, ASSIGN}] 2023-11-01 09:54:31,251 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e2584f1b9fc06508be08e77278378d04, ASSIGN 2023-11-01 09:54:31,251 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3fee1307da01b6d821587a0ba912a96d, ASSIGN 2023-11-01 09:54:31,251 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=69910e0ca18b4fdfb4a00f4bd1dc27f0, ASSIGN 2023-11-01 09:54:31,252 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e2584f1b9fc06508be08e77278378d04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:31,252 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3fee1307da01b6d821587a0ba912a96d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:31,252 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=69910e0ca18b4fdfb4a00f4bd1dc27f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:31,403 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=69910e0ca18b4fdfb4a00f4bd1dc27f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,404 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=e2584f1b9fc06508be08e77278378d04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,404 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3fee1307da01b6d821587a0ba912a96d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,404 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698832471403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832471403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832471403"}]},"ts":"1698832471403"} 2023-11-01 09:54:31,404 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698832471403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832471403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832471403"}]},"ts":"1698832471403"} 2023-11-01 09:54:31,404 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698832471403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832471403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832471403"}]},"ts":"1698832471403"} 2023-11-01 09:54:31,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 69910e0ca18b4fdfb4a00f4bd1dc27f0, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:31,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure e2584f1b9fc06508be08e77278378d04, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:31,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 3fee1307da01b6d821587a0ba912a96d, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:31,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-01 09:54:31,502 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/.tmp/family1/1926956337b14ad68353b3762fed3ad4 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/1926956337b14ad68353b3762fed3ad4 2023-11-01 09:54:31,507 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1388645b6ecdeccc3d9fbf68cdb7b63c/family1 of 1388645b6ecdeccc3d9fbf68cdb7b63c into 1926956337b14ad68353b3762fed3ad4(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:54:31,507 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:54:31,507 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1698832470261; duration=1sec 2023-11-01 09:54:31,508 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:31,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/761c64b796a14def9863b9465e2bf30f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/24d240e26ee84ac3b6d6355492ccb10f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_] to archive 2023-11-01 09:54:31,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:31,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/761c64b796a14def9863b9465e2bf30f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/761c64b796a14def9863b9465e2bf30f 2023-11-01 09:54:31,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/24d240e26ee84ac3b6d6355492ccb10f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/24d240e26ee84ac3b6d6355492ccb10f 2023-11-01 09:54:31,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/family1/ea4e1ed1db1b44999f715af29a918c98_SeqId_47_ 2023-11-01 09:54:31,558 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:31,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2584f1b9fc06508be08e77278378d04, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.', STARTKEY => '2', ENDKEY => ''} 2023-11-01 09:54:31,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:31,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,562 INFO [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,563 DEBUG [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1 2023-11-01 09:54:31,563 DEBUG [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1 2023-11-01 09:54:31,564 INFO [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2584f1b9fc06508be08e77278378d04 columnFamilyName family1 2023-11-01 09:54:31,565 INFO [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] regionserver.HStore(310): Store=e2584f1b9fc06508be08e77278378d04/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:31,565 INFO [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,567 DEBUG [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family2 2023-11-01 09:54:31,567 DEBUG [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family2 2023-11-01 09:54:31,567 INFO [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2584f1b9fc06508be08e77278378d04 columnFamilyName family2 2023-11-01 09:54:31,568 INFO [StoreOpener-e2584f1b9fc06508be08e77278378d04-1] regionserver.HStore(310): Store=e2584f1b9fc06508be08e77278378d04/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:31,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:54:31,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e2584f1b9fc06508be08e77278378d04 2023-11-01 09:54:31,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:31,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e2584f1b9fc06508be08e77278378d04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63048774, jitterRate=-0.06050005555152893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:54:31,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:54:31,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04., pid=32, masterSystemTime=1698832471558 2023-11-01 09:54:31,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:31,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:31,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3fee1307da01b6d821587a0ba912a96d, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.', STARTKEY => '1', ENDKEY => '2'} 2023-11-01 09:54:31,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:31,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,576 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=e2584f1b9fc06508be08e77278378d04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698832471576"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832471576"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832471576"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832471576"}]},"ts":"1698832471576"} 2023-11-01 09:54:31,577 INFO [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,578 DEBUG [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d/family1 2023-11-01 09:54:31,579 DEBUG [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d/family1 2023-11-01 09:54:31,579 INFO [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fee1307da01b6d821587a0ba912a96d columnFamilyName family1 2023-11-01 09:54:31,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-11-01 09:54:31,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure e2584f1b9fc06508be08e77278378d04, server=jenkins-hbase4.apache.org,40233,1698832432817 in 172 msec 2023-11-01 09:54:31,580 INFO [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] regionserver.HStore(310): Store=3fee1307da01b6d821587a0ba912a96d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:31,580 INFO [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e2584f1b9fc06508be08e77278378d04, ASSIGN in 331 msec 2023-11-01 09:54:31,582 DEBUG [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d/family2 2023-11-01 09:54:31,582 DEBUG [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d/family2 2023-11-01 09:54:31,582 INFO [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fee1307da01b6d821587a0ba912a96d columnFamilyName family2 2023-11-01 09:54:31,583 INFO [StoreOpener-3fee1307da01b6d821587a0ba912a96d-1] regionserver.HStore(310): Store=3fee1307da01b6d821587a0ba912a96d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:54:31,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:54:31,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:31,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3fee1307da01b6d821587a0ba912a96d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60277547, jitterRate=-0.10179455578327179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:54:31,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3fee1307da01b6d821587a0ba912a96d: 2023-11-01 09:54:31,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d., pid=33, masterSystemTime=1698832471558 2023-11-01 09:54:31,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:31,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69910e0ca18b4fdfb4a00f4bd1dc27f0, NAME => 'testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.', STARTKEY => '', ENDKEY => '1'} 2023-11-01 09:54:31,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,592 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3fee1307da01b6d821587a0ba912a96d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:31,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,592 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698832471592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832471592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832471592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832471592"}]},"ts":"1698832471592"} 2023-11-01 09:54:31,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,593 INFO [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,594 DEBUG [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0/family1 2023-11-01 09:54:31,594 DEBUG [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0/family1 2023-11-01 09:54:31,595 INFO [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69910e0ca18b4fdfb4a00f4bd1dc27f0 columnFamilyName family1 2023-11-01 09:54:31,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=29 2023-11-01 09:54:31,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 3fee1307da01b6d821587a0ba912a96d, server=jenkins-hbase4.apache.org,40233,1698832432817 in 186 msec 2023-11-01 09:54:31,596 INFO [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] regionserver.HStore(310): Store=69910e0ca18b4fdfb4a00f4bd1dc27f0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:31,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3fee1307da01b6d821587a0ba912a96d, ASSIGN in 346 msec 2023-11-01 09:54:31,596 INFO [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,598 DEBUG [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0/family2 2023-11-01 09:54:31,598 DEBUG [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0/family2 2023-11-01 09:54:31,598 INFO [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69910e0ca18b4fdfb4a00f4bd1dc27f0 columnFamilyName family2 2023-11-01 09:54:31,599 INFO [StoreOpener-69910e0ca18b4fdfb4a00f4bd1dc27f0-1] regionserver.HStore(310): Store=69910e0ca18b4fdfb4a00f4bd1dc27f0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:31,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:54:31,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:54:31,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:31,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69910e0ca18b4fdfb4a00f4bd1dc27f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59215908, jitterRate=-0.11761420965194702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:54:31,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69910e0ca18b4fdfb4a00f4bd1dc27f0: 2023-11-01 09:54:31,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0., pid=31, masterSystemTime=1698832471558 2023-11-01 09:54:31,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:31,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=69910e0ca18b4fdfb4a00f4bd1dc27f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:31,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698832471614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832471614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832471614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832471614"}]},"ts":"1698832471614"} 2023-11-01 09:54:31,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-11-01 09:54:31,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 69910e0ca18b4fdfb4a00f4bd1dc27f0, server=jenkins-hbase4.apache.org,40233,1698832432817 in 211 msec 2023-11-01 09:54:31,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-11-01 09:54:31,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=69910e0ca18b4fdfb4a00f4bd1dc27f0, ASSIGN in 369 msec 2023-11-01 09:54:31,621 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:54:31,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832471621"}]},"ts":"1698832471621"} 2023-11-01 09:54:31,622 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-01 09:54:31,625 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:54:31,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2310 sec 2023-11-01 09:54:32,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-01 09:54:32,503 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-01 09:54:32,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:32,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,513 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-01 09:54:32,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:32,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-01 09:54:32,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-01 09:54:32,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,515 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:32,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:32,515 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:32,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,517 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,517 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:32,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-01 09:54:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-01 09:54:32,518 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:32,518 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. started... 2023-11-01 09:54:32,518 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:32,519 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. started... 2023-11-01 09:54:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:54:32,520 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:32,520 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e2584f1b9fc06508be08e77278378d04 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-01 09:54:32,519 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3fee1307da01b6d821587a0ba912a96d: 2023-11-01 09:54:32,519 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:32,520 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:32,521 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:54:32,521 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. started... 2023-11-01 09:54:32,521 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 69910e0ca18b4fdfb4a00f4bd1dc27f0: 2023-11-01 09:54:32,521 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:32,522 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:54:32,537 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110180026a8e35c54fe1902a64d2d28053b6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023110180026a8e35c54fe1902a64d2d28053b6 2023-11-01 09:54:32,944 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/.tmp/family1/24d2825e6c914004bb7710d8d3e3b822 2023-11-01 09:54:32,950 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/.tmp/family1/24d2825e6c914004bb7710d8d3e3b822 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/24d2825e6c914004bb7710d8d3e3b822 2023-11-01 09:54:32,954 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/24d2825e6c914004bb7710d8d3e3b822, entries=1, sequenceid=5, filesize=4.9 K 2023-11-01 09:54:32,955 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for e2584f1b9fc06508be08e77278378d04 in 435ms, sequenceid=5, compaction requested=false 2023-11-01 09:54:32,955 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-01 09:54:32,956 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:54:32,956 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:32,956 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:54:32,956 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:54:32,956 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,956 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-01 09:54:32,956 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-01 09:54:32,958 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,958 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:32,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:32,959 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,959 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:32,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-01 09:54:32,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d6a643[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:32,960 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-01 09:54:32,960 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,961 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-01 09:54:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-01 09:54:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:32,962 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,962 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:32,963 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-01 09:54:32,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:32,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-01 09:54:32,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:32,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:32,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:32,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:32,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-01 09:54:32,966 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-01 09:54:32,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:32,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:32,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,966 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:32,967 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,967 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:32,967 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,968 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:32,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,969 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:32,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:32,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-01 09:54:32,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:32,975 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,976 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,976 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:32,975 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:32,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-01 09:54:32,976 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:32,976 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:32,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:33,076 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:33,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:33,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:33,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:33,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,083 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-01 09:54:33,083 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:33,083 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-01 09:54:33,083 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-01 09:54:33,084 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,084 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,085 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:33,085 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:33,085 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,085 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,086 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-01 09:54:33,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,086 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-01 09:54:33,086 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:33,086 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. started... 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:33,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:54:33,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3fee1307da01b6d821587a0ba912a96d: 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. started... 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. started... 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 69910e0ca18b4fdfb4a00f4bd1dc27f0: 2023-11-01 09:54:33,087 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing e2584f1b9fc06508be08e77278378d04 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-01 09:54:33,087 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:54:33,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:54:33,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:54:33,501 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311019f58b0fe27124cc28b251fd06579b040 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311019f58b0fe27124cc28b251fd06579b040 2023-11-01 09:54:33,506 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/.tmp/family1/536538869e3b4bebb4e3a6e25ae5e5aa 2023-11-01 09:54:33,512 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/.tmp/family1/536538869e3b4bebb4e3a6e25ae5e5aa as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/536538869e3b4bebb4e3a6e25ae5e5aa 2023-11-01 09:54:33,516 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/536538869e3b4bebb4e3a6e25ae5e5aa, entries=2, sequenceid=9, filesize=5.0 K 2023-11-01 09:54:33,517 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for e2584f1b9fc06508be08e77278378d04 in 430ms, sequenceid=9, compaction requested=false 2023-11-01 09:54:33,517 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:54:33,517 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:54:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:54:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-01 09:54:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-01 09:54:33,519 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,519 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:33,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-01 09:54:33,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253dfa0[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:33,522 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-01 09:54:33,522 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,523 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,523 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-01 09:54:33,523 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-01 09:54:33,523 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:33,523 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,523 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:33,526 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-01 09:54:33,526 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:33,526 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,526 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-01 09:54:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:33,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:33,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-01 09:54:33,529 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-01 09:54:33,529 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:33,529 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:33,529 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,529 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:33,531 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,531 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,531 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:33,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,531 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:33,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:33,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,533 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,535 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:33,536 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:33,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-01 09:54:33,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:33,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-01 09:54:33,536 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:33,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:33,637 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:33,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:33,644 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-01 09:54:33,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-01 09:54:33,647 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-01 09:54:33,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:33,647 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833073647 2023-11-01 09:54:33,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:54:33,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-01 09:54:33,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-01 09:54:33,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x729a806a to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:33,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d0cca50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:33,654 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231101 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-01 09:54:34,482 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110159d25c3f1a004b3c992f3c84a8761db0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023110159d25c3f1a004b3c992f3c84a8761db0 2023-11-01 09:54:34,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-01 09:54:34,498 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:34,499 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:34,507 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:34,509 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:34,519 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231101/family1/7cdc1148119648e68091d643cf1dc58a first=Optional[k0] last=Optional[k1] 2023-11-01 09:54:34,520 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231101/family1/7cdc1148119648e68091d643cf1dc58a}] 2023-11-01 09:54:34,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231101/family1/7cdc1148119648e68091d643cf1dc58a for inclusion in e2584f1b9fc06508be08e77278378d04/family1 2023-11-01 09:54:34,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-01 09:54:34,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-01 09:54:34,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:54:34,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231101/family1/7cdc1148119648e68091d643cf1dc58a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testScannerOnBulkLoadRefHFiles__l46u2klc79rc3uvmae3l2nqd74v9ubgf2f7ldpm08014f66hvi9h425ic3jimrmq/family1/7cdc1148119648e68091d643cf1dc58a 2023-11-01 09:54:34,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testScannerOnBulkLoadRefHFiles__l46u2klc79rc3uvmae3l2nqd74v9ubgf2f7ldpm08014f66hvi9h425ic3jimrmq/family1/7cdc1148119648e68091d643cf1dc58a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_ 2023-11-01 09:54:34,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testScannerOnBulkLoadRefHFiles__l46u2klc79rc3uvmae3l2nqd74v9ubgf2f7ldpm08014f66hvi9h425ic3jimrmq/family1/7cdc1148119648e68091d643cf1dc58a into e2584f1b9fc06508be08e77278378d04/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_ - updating store file list. 2023-11-01 09:54:34,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_ into e2584f1b9fc06508be08e77278378d04/family1 2023-11-01 09:54:34,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testScannerOnBulkLoadRefHFiles__l46u2klc79rc3uvmae3l2nqd74v9ubgf2f7ldpm08014f66hvi9h425ic3jimrmq/family1/7cdc1148119648e68091d643cf1dc58a into e2584f1b9fc06508be08e77278378d04/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_) 2023-11-01 09:54:34,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testScannerOnBulkLoadRefHFiles__l46u2klc79rc3uvmae3l2nqd74v9ubgf2f7ldpm08014f66hvi9h425ic3jimrmq/family1/7cdc1148119648e68091d643cf1dc58a 2023-11-01 09:54:34,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:54:34,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:54:34,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): e2584f1b9fc06508be08e77278378d04/family1 is initiating minor compaction (all files) 2023-11-01 09:54:34,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2af9328a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:34,536 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e2584f1b9fc06508be08e77278378d04/family1 in testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:54:34,537 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/24d2825e6c914004bb7710d8d3e3b822, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/536538869e3b4bebb4e3a6e25ae5e5aa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/.tmp, totalSize=15.1 K 2023-11-01 09:54:34,537 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 24d2825e6c914004bb7710d8d3e3b822, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832472503 2023-11-01 09:54:34,538 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 536538869e3b4bebb4e3a6e25ae5e5aa, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832472503 2023-11-01 09:54:34,538 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832472503 2023-11-01 09:54:34,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-01 09:54:34,539 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:34,541 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023110180026a8e35c54fe1902a64d2d28053b6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023110180026a8e35c54fe1902a64d2d28053b6 2023-11-01 09:54:34,542 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311019f58b0fe27124cc28b251fd06579b040 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311019f58b0fe27124cc28b251fd06579b040 2023-11-01 09:54:34,542 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-01 09:54:34,542 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231101' 2023-11-01 09:54:34,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231101 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-01 09:54:34,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-01 09:54:34,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:34,544 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-01 09:54:34,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 899 msec 2023-11-01 09:54:34,549 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): e2584f1b9fc06508be08e77278378d04#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:34,574 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=258 (was 258), OpenFileDescriptor=609 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 312), ProcessCount=169 (was 169), AvailableMemoryMB=10714 (was 10738) 2023-11-01 09:54:34,584 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=609, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=169, AvailableMemoryMB=10714 2023-11-01 09:54:34,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-01 09:54:34,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:34,588 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:54:34,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-01 09:54:34,589 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:54:34,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-01 09:54:34,590 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:34,590 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f empty. 2023-11-01 09:54:34,591 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:34,591 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-01 09:54:34,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-01 09:54:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-01 09:54:34,971 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/.tmp/family1/711e739960d6436c87cffce3cd71d6c9 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/711e739960d6436c87cffce3cd71d6c9 2023-11-01 09:54:34,977 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e2584f1b9fc06508be08e77278378d04/family1 of e2584f1b9fc06508be08e77278378d04 into 711e739960d6436c87cffce3cd71d6c9(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:34,977 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:54:34,977 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698832474536; duration=0sec 2023-11-01 09:54:34,978 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:34,998 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:35,000 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2545414ff76df89ec2e286e567bebe0f, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:35,016 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:35,016 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 2545414ff76df89ec2e286e567bebe0f, disabling compactions & flushes 2023-11-01 09:54:35,016 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,016 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,016 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. after waiting 0 ms 2023-11-01 09:54:35,016 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,016 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,016 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:35,020 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:54:35,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698832475021"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832475021"}]},"ts":"1698832475021"} 2023-11-01 09:54:35,023 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:54:35,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:54:35,024 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832475024"}]},"ts":"1698832475024"} 2023-11-01 09:54:35,025 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-01 09:54:35,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=2545414ff76df89ec2e286e567bebe0f, ASSIGN}] 2023-11-01 09:54:35,032 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=2545414ff76df89ec2e286e567bebe0f, ASSIGN 2023-11-01 09:54:35,032 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=2545414ff76df89ec2e286e567bebe0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:35,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/24d2825e6c914004bb7710d8d3e3b822, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/536538869e3b4bebb4e3a6e25ae5e5aa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_] to archive 2023-11-01 09:54:35,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:35,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/24d2825e6c914004bb7710d8d3e3b822 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/24d2825e6c914004bb7710d8d3e3b822 2023-11-01 09:54:35,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/536538869e3b4bebb4e3a6e25ae5e5aa to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/536538869e3b4bebb4e3a6e25ae5e5aa 2023-11-01 09:54:35,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/family1/1a70d5ef4e204b71ad5a7789101e260b_SeqId_12_ 2023-11-01 09:54:35,184 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=2545414ff76df89ec2e286e567bebe0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,184 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698832475183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832475183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832475183"}]},"ts":"1698832475183"} 2023-11-01 09:54:35,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 2545414ff76df89ec2e286e567bebe0f, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:35,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-01 09:54:35,344 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2545414ff76df89ec2e286e567bebe0f, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:54:35,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:35,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,349 INFO [StoreOpener-2545414ff76df89ec2e286e567bebe0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,351 DEBUG [StoreOpener-2545414ff76df89ec2e286e567bebe0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1 2023-11-01 09:54:35,351 DEBUG [StoreOpener-2545414ff76df89ec2e286e567bebe0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1 2023-11-01 09:54:35,351 INFO [StoreOpener-2545414ff76df89ec2e286e567bebe0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2545414ff76df89ec2e286e567bebe0f columnFamilyName family1 2023-11-01 09:54:35,353 INFO [StoreOpener-2545414ff76df89ec2e286e567bebe0f-1] regionserver.HStore(310): Store=2545414ff76df89ec2e286e567bebe0f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:35,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:54:35,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:35,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2545414ff76df89ec2e286e567bebe0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71812654, jitterRate=0.07009193301200867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:54:35,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:35,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f., pid=37, masterSystemTime=1698832475344 2023-11-01 09:54:35,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,364 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=2545414ff76df89ec2e286e567bebe0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,364 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698832475364"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832475364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832475364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832475364"}]},"ts":"1698832475364"} 2023-11-01 09:54:35,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-01 09:54:35,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 2545414ff76df89ec2e286e567bebe0f, server=jenkins-hbase4.apache.org,40233,1698832432817 in 173 msec 2023-11-01 09:54:35,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-01 09:54:35,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=2545414ff76df89ec2e286e567bebe0f, ASSIGN in 338 msec 2023-11-01 09:54:35,370 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:54:35,370 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832475370"}]},"ts":"1698832475370"} 2023-11-01 09:54:35,371 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-01 09:54:35,374 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:54:35,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 788 msec 2023-11-01 09:54:35,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-01 09:54:35,694 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-01 09:54:35,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:35,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,753 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:35,753 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:35,753 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:35,753 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:35,754 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,754 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,755 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:35,755 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:35,756 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,756 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:35,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:35,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:35,757 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:35,765 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:35,765 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:35,765 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,765 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:35,766 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:54:35,789 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307a0a397e9429430287defc280749f4b4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307a0a397e9429430287defc280749f4b4 2023-11-01 09:54:35,795 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/02f9923e6ead45bc80b5cf6593f609fd 2023-11-01 09:54:35,801 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/02f9923e6ead45bc80b5cf6593f609fd as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/02f9923e6ead45bc80b5cf6593f609fd 2023-11-01 09:54:35,807 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/02f9923e6ead45bc80b5cf6593f609fd, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-01 09:54:35,808 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 42ms, sequenceid=5, compaction requested=false 2023-11-01 09:54:35,808 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:35,809 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:35,809 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:35,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:35,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:35,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:35,812 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,812 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:35,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:35,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ab7f4ca[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:35,814 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:35,814 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,816 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:35,816 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:35,816 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:35,816 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,816 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:35,818 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:35,818 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:35,818 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:35,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:35,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:35,824 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:35,824 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:35,824 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:35,824 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,824 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:35,826 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,826 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:35,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,826 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:35,828 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,830 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,833 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:35,833 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,833 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:35,833 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:35,833 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:35,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:35,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:35,833 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,834 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:35,834 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:35,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:35,834 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:35,834 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:35,834 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,835 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,934 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:35,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:35,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:35,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:35,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,941 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:35,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:35,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:35,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:35,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,941 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,942 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,942 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:35,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:35,943 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:35,943 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,943 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:35,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:35,944 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:35,944 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:35,944 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:54:36,358 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a3a8c026f9e44b29a4674edfc06ffe11 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128a3a8c026f9e44b29a4674edfc06ffe11 2023-11-01 09:54:36,766 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/c1a00af9e1184f93a60224a42431a597 2023-11-01 09:54:36,771 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/c1a00af9e1184f93a60224a42431a597 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/c1a00af9e1184f93a60224a42431a597 2023-11-01 09:54:36,775 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/c1a00af9e1184f93a60224a42431a597, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:54:36,776 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 832ms, sequenceid=9, compaction requested=false 2023-11-01 09:54:36,776 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:36,776 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:36,776 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:36,776 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:36,776 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,776 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:36,777 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,778 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:36,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:36,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5ff251[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:36,780 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:36,780 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,781 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:36,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:36,787 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:36,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:36,790 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:36,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:36,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:36,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,790 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:36,791 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,791 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:36,791 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:36,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:36,792 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,793 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:36,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:36,795 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:36,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:36,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:36,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:36,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:36,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:36,795 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,796 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,796 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:36,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:36,796 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:36,896 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:36,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:36,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:36,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:36,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,903 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:36,903 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:36,903 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:36,903 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:36,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,905 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,905 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:36,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:36,905 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:36,906 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:36,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:36,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:36,907 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:36,907 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:36,907 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:37,096 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:54:37,320 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d01693ba60274158a48cfeb016cea96b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d01693ba60274158a48cfeb016cea96b 2023-11-01 09:54:37,726 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/303786a37b334f4b9826c132880037fb 2023-11-01 09:54:37,731 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/303786a37b334f4b9826c132880037fb as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/303786a37b334f4b9826c132880037fb 2023-11-01 09:54:37,735 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/303786a37b334f4b9826c132880037fb, entries=1, sequenceid=13, filesize=4.9 K 2023-11-01 09:54:37,736 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 829ms, sequenceid=13, compaction requested=true 2023-11-01 09:54:37,736 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:37,736 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:37,738 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,738 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:37,738 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,738 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:37,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:37,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b0ab5e7[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:37,740 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:37,740 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,741 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,741 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:37,741 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:37,741 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:37,741 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,741 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:37,743 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:37,745 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:37,745 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:37,745 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:37,745 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,745 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:37,747 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,747 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,747 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:37,747 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,749 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:37,751 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:37,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:37,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:37,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:37,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:37,751 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:37,852 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:37,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:37,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:37,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:37,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,858 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:37,858 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:37,858 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:37,858 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:37,859 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,859 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,860 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,860 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:37,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:37,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:37,860 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:37,860 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:37,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:37,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,861 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,861 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:37,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:37,861 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:37,861 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:37,861 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:37,862 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:37,862 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:37,862 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:38,275 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053a00cde576dc457a98a3ef4b97057e27 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053a00cde576dc457a98a3ef4b97057e27 2023-11-01 09:54:38,681 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/632cf80ae1264fa8954f33ebac5087a4 2023-11-01 09:54:38,686 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/632cf80ae1264fa8954f33ebac5087a4 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/632cf80ae1264fa8954f33ebac5087a4 2023-11-01 09:54:38,690 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/632cf80ae1264fa8954f33ebac5087a4, entries=1, sequenceid=17, filesize=4.9 K 2023-11-01 09:54:38,690 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 828ms, sequenceid=17, compaction requested=true 2023-11-01 09:54:38,691 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:38,691 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:38,691 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:38,691 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:38,691 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,691 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:38,691 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,697 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,697 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4738cff9[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:38,698 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:38,698 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,699 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,700 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:38,700 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:38,700 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:38,700 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,700 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:38,701 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:38,703 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:38,703 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:38,703 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:38,703 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,703 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:38,705 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,705 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:38,705 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:38,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:38,706 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,707 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:38,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:38,714 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:38,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:38,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:38,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:38,714 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:38,715 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:38,815 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:38,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:38,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:38,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:38,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,821 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:38,821 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:38,822 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:38,822 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:38,822 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,822 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,823 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,823 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:38,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:38,823 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:38,824 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:38,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:38,825 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:38,825 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:38,825 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:38,825 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:38,825 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:38,825 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:38,825 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:38,825 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:39,237 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122844deb3da0d6640028d6459af8f423625 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122844deb3da0d6640028d6459af8f423625 2023-11-01 09:54:39,643 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/696a868b2c864ed2b5dec489b21ee2f3 2023-11-01 09:54:39,648 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/696a868b2c864ed2b5dec489b21ee2f3 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/696a868b2c864ed2b5dec489b21ee2f3 2023-11-01 09:54:39,652 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/696a868b2c864ed2b5dec489b21ee2f3, entries=1, sequenceid=21, filesize=4.9 K 2023-11-01 09:54:39,653 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 828ms, sequenceid=21, compaction requested=true 2023-11-01 09:54:39,653 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:39,653 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:39,653 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:39,653 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:39,653 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,653 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:39,654 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:39,658 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,658 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:39,658 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,658 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12fc6270[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:39,660 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:39,660 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,661 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:39,661 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,661 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:39,662 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:39,665 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:39,665 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:39,665 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:39,665 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,665 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:39,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:39,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:39,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:39,668 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,669 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:39,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:39,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:39,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:39,671 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:39,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:39,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:39,772 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:39,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:39,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:39,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:39,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,778 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:39,778 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:39,778 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:39,778 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:39,778 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,778 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,780 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,780 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:39,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:39,780 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:39,780 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:39,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:39,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:39,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:39,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:39,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:39,781 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:39,781 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:39,781 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:39,781 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:40,194 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123173b5e41f318548109229ea57c34b15ac to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123173b5e41f318548109229ea57c34b15ac 2023-11-01 09:54:40,599 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/233825b433fa4a18adaedddda87b8118 2023-11-01 09:54:40,604 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/233825b433fa4a18adaedddda87b8118 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/233825b433fa4a18adaedddda87b8118 2023-11-01 09:54:40,608 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/233825b433fa4a18adaedddda87b8118, entries=1, sequenceid=25, filesize=4.9 K 2023-11-01 09:54:40,609 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 828ms, sequenceid=25, compaction requested=true 2023-11-01 09:54:40,609 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:40,609 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:40,609 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:40,609 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:40,609 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,609 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:40,609 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:40,611 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,611 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:40,611 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,611 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:40,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:40,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:40,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@724d704[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:40,613 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:40,613 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,615 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:40,615 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,615 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:40,616 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:40,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:40,619 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:40,619 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:40,619 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:40,619 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,619 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:40,620 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,620 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,620 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:40,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:40,621 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:40,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,622 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:40,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,625 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:40,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:40,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:40,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:40,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,625 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:40,726 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:40,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:40,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:40,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:40,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,732 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:40,732 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:40,732 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:40,732 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:40,733 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,733 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,734 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,734 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:40,735 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:40,735 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,736 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:40,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:40,736 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:40,736 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:40,736 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:41,148 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101eab24db29c334405adc2dc42fb9ac88a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101eab24db29c334405adc2dc42fb9ac88a 2023-11-01 09:54:41,554 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/d56161b9de6a41a580e62e547e709d18 2023-11-01 09:54:41,559 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/d56161b9de6a41a580e62e547e709d18 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d56161b9de6a41a580e62e547e709d18 2023-11-01 09:54:41,563 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d56161b9de6a41a580e62e547e709d18, entries=1, sequenceid=29, filesize=4.9 K 2023-11-01 09:54:41,564 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 828ms, sequenceid=29, compaction requested=true 2023-11-01 09:54:41,564 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:41,564 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,566 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:41,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:41,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@98fff8a[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:41,567 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:41,567 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,568 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,569 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:41,569 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:41,569 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:41,569 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,569 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:41,570 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,570 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:41,570 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:41,570 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:41,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:41,572 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:41,572 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:41,572 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:41,572 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,572 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:41,579 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,579 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,579 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:41,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:41,580 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,581 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,583 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,583 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:41,583 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:41,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:41,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,584 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:41,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:41,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,584 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,684 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:41,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:41,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:41,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:41,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,690 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:41,690 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:41,691 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:41,691 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:41,691 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,691 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:41,695 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:41,695 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:41,695 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:41,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:41,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:41,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:41,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:41,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:41,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:41,696 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:41,696 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:41,697 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:42,109 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c5c4a1a2a90043509bf20fba8c2de283 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5c4a1a2a90043509bf20fba8c2de283 2023-11-01 09:54:42,114 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/d007ea568e2a4e008b3f0d888d8e7a1c 2023-11-01 09:54:42,119 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/d007ea568e2a4e008b3f0d888d8e7a1c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d007ea568e2a4e008b3f0d888d8e7a1c 2023-11-01 09:54:42,123 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d007ea568e2a4e008b3f0d888d8e7a1c, entries=1, sequenceid=33, filesize=4.9 K 2023-11-01 09:54:42,124 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 427ms, sequenceid=33, compaction requested=true 2023-11-01 09:54:42,124 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:42,124 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:42,124 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:42,124 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:42,124 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,124 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:42,124 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:42,125 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,125 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:42,126 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,126 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:42,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:42,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8c9be45[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:42,127 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:42,127 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,128 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:42,128 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:42,128 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:42,128 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,128 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:42,130 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:42,130 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,130 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:42,130 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:42,132 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:42,132 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:42,132 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:42,132 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,132 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:42,134 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,134 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:42,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,134 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:42,135 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,136 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,138 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:42,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:42,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,139 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:42,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:42,139 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,140 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,239 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:42,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:42,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:42,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:42,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,246 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:42,246 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:42,246 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:42,246 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:42,246 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,246 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,247 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:42,247 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:42,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:42,248 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:42,248 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,249 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:42,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:42,249 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:42,249 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:42,249 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:42,249 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:42,249 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:42,249 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:42,249 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:42,249 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:42,662 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074ce6cd1360074666b4f271b9cf0777aa to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509074ce6cd1360074666b4f271b9cf0777aa 2023-11-01 09:54:43,067 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/bf42425224664147b7ef631be9db17bc 2023-11-01 09:54:43,072 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/bf42425224664147b7ef631be9db17bc as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/bf42425224664147b7ef631be9db17bc 2023-11-01 09:54:43,076 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/bf42425224664147b7ef631be9db17bc, entries=1, sequenceid=37, filesize=4.9 K 2023-11-01 09:54:43,077 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 828ms, sequenceid=37, compaction requested=true 2023-11-01 09:54:43,077 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:43,077 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:43,079 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,079 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:43,079 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,079 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:43,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:43,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:43,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d7b2ce[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:43,080 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:43,081 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,083 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,083 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:43,083 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:43,083 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:43,083 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,083 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:43,084 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:43,084 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,084 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:43,085 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:43,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:43,087 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:43,087 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:43,087 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:43,087 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,087 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:43,088 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,088 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,088 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:43,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:43,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:43,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:43,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:43,089 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:43,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:43,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,090 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:43,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,092 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:43,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:43,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:43,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:43,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:43,092 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:43,193 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:43,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:43,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:43,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:43,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,199 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:43,199 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:43,199 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-01 09:54:43,199 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-01 09:54:43,200 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,200 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,202 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,202 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:43,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:43,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:43,202 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:43,202 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:43,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,203 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,203 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-01 09:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:43,203 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-01 09:54:43,203 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:43,203 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-01 09:54:43,203 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:43,203 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:43,203 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:43,203 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. started... 2023-11-01 09:54:43,203 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2545414ff76df89ec2e286e567bebe0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:43,616 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f3ea776c850447b1a675a244183111a1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120f3ea776c850447b1a675a244183111a1 2023-11-01 09:54:44,021 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/7ecbbb864a9e45a1b163b5d74a99e036 2023-11-01 09:54:44,025 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/7ecbbb864a9e45a1b163b5d74a99e036 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/7ecbbb864a9e45a1b163b5d74a99e036 2023-11-01 09:54:44,029 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/7ecbbb864a9e45a1b163b5d74a99e036, entries=1, sequenceid=41, filesize=4.9 K 2023-11-01 09:54:44,030 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2545414ff76df89ec2e286e567bebe0f in 827ms, sequenceid=41, compaction requested=true 2023-11-01 09:54:44,030 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:44,030 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-01 09:54:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-01 09:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,032 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:44,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-01 09:54:44,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@586ac607[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:44,034 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-01 09:54:44,034 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,035 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-01 09:54:44,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-01 09:54:44,035 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,035 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:44,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:44,036 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-01 09:54:44,036 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,036 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:44,036 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-01 09:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:44,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:44,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:44,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:54:44,038 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-01 09:54:44,038 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:44,038 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:44,038 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,038 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:44,040 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,040 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:44,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,040 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:44,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:44,041 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,042 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:44,047 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:44,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:44,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-01 09:54:44,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-01 09:54:44,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:44,047 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:44,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:44,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:44,148 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:44,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:44,150 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-01 09:54:44,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:44,152 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:44,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:44,153 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833084152 2023-11-01 09:54:44,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:54:44,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-01 09:54:44,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:44,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x4ab5c14d to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:44,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e0cc01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:44,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,000 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036464aaf4ee394e9987426cdfc97bdf66 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601036464aaf4ee394e9987426cdfc97bdf66 2023-11-01 09:54:45,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:45,014 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:45,015 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:45,021 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:45,022 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:45,030 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b37b63ac3711499c8242485c7174a91d first=Optional[r3] last=Optional[r6] 2023-11-01 09:54:45,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b37b63ac3711499c8242485c7174a91d}] 2023-11-01 09:54:45,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b37b63ac3711499c8242485c7174a91d for inclusion in 2545414ff76df89ec2e286e567bebe0f/family1 2023-11-01 09:54:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-01 09:54:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b37b63ac3711499c8242485c7174a91d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6jg6i2kadfejvksrg6ioasn1d71t2laq802as9cr29j7khvbefh7emj64lgiua6o/family1/b37b63ac3711499c8242485c7174a91d 2023-11-01 09:54:45,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6jg6i2kadfejvksrg6ioasn1d71t2laq802as9cr29j7khvbefh7emj64lgiua6o/family1/b37b63ac3711499c8242485c7174a91d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_ 2023-11-01 09:54:45,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6jg6i2kadfejvksrg6ioasn1d71t2laq802as9cr29j7khvbefh7emj64lgiua6o/family1/b37b63ac3711499c8242485c7174a91d into 2545414ff76df89ec2e286e567bebe0f/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_ - updating store file list. 2023-11-01 09:54:45,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_ into 2545414ff76df89ec2e286e567bebe0f/family1 2023-11-01 09:54:45,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6jg6i2kadfejvksrg6ioasn1d71t2laq802as9cr29j7khvbefh7emj64lgiua6o/family1/b37b63ac3711499c8242485c7174a91d into 2545414ff76df89ec2e286e567bebe0f/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_) 2023-11-01 09:54:45,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6jg6i2kadfejvksrg6ioasn1d71t2laq802as9cr29j7khvbefh7emj64lgiua6o/family1/b37b63ac3711499c8242485c7174a91d 2023-11-01 09:54:45,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:54:45,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:54:45,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 2545414ff76df89ec2e286e567bebe0f/family1 is initiating minor compaction 2023-11-01 09:54:45,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@11a531d2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:45,048 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2545414ff76df89ec2e286e567bebe0f/family1 in testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:45,048 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/c1a00af9e1184f93a60224a42431a597, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/303786a37b334f4b9826c132880037fb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/632cf80ae1264fa8954f33ebac5087a4, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/696a868b2c864ed2b5dec489b21ee2f3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/233825b433fa4a18adaedddda87b8118, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d56161b9de6a41a580e62e547e709d18, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d007ea568e2a4e008b3f0d888d8e7a1c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/bf42425224664147b7ef631be9db17bc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/7ecbbb864a9e45a1b163b5d74a99e036, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp, totalSize=50.0 K 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting c1a00af9e1184f93a60224a42431a597, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 303786a37b334f4b9826c132880037fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 632cf80ae1264fa8954f33ebac5087a4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 696a868b2c864ed2b5dec489b21ee2f3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 233825b433fa4a18adaedddda87b8118, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting d56161b9de6a41a580e62e547e709d18, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting d007ea568e2a4e008b3f0d888d8e7a1c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting bf42425224664147b7ef631be9db17bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 7ecbbb864a9e45a1b163b5d74a99e036, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:54:45,048 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting ad1da5e275284b35b5496ceded87dc48_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:54:45,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:45,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:45,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122844deb3da0d6640028d6459af8f423625 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122844deb3da0d6640028d6459af8f423625 2023-11-01 09:54:45,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123173b5e41f318548109229ea57c34b15ac to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123173b5e41f318548109229ea57c34b15ac 2023-11-01 09:54:45,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101eab24db29c334405adc2dc42fb9ac88a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101eab24db29c334405adc2dc42fb9ac88a 2023-11-01 09:54:45,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5c4a1a2a90043509bf20fba8c2de283 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5c4a1a2a90043509bf20fba8c2de283 2023-11-01 09:54:45,056 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-01 09:54:45,056 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-01 09:54:45,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,082 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2545414ff76df89ec2e286e567bebe0f#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:45,901 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/67c1aba948924318b67d5ace6bbe5307 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/67c1aba948924318b67d5ace6bbe5307 2023-11-01 09:54:45,906 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2545414ff76df89ec2e286e567bebe0f/family1 of 2545414ff76df89ec2e286e567bebe0f into 67c1aba948924318b67d5ace6bbe5307(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:45,906 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:45,906 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698832485047; duration=0sec 2023-11-01 09:54:45,906 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:45,914 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120541512d0dbd3b4afcb68dd65a4362f78c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120541512d0dbd3b4afcb68dd65a4362f78c 2023-11-01 09:54:45,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:45,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/c1a00af9e1184f93a60224a42431a597, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/303786a37b334f4b9826c132880037fb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/632cf80ae1264fa8954f33ebac5087a4, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/696a868b2c864ed2b5dec489b21ee2f3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/233825b433fa4a18adaedddda87b8118, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d56161b9de6a41a580e62e547e709d18, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d007ea568e2a4e008b3f0d888d8e7a1c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/bf42425224664147b7ef631be9db17bc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/7ecbbb864a9e45a1b163b5d74a99e036, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_] to archive 2023-11-01 09:54:45,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:45,957 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/74e290407f12419abba9c5e637abc4d0 first=Optional[r00] last=Optional[r2] 2023-11-01 09:54:45,958 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/74e290407f12419abba9c5e637abc4d0}] 2023-11-01 09:54:45,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/c1a00af9e1184f93a60224a42431a597 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/c1a00af9e1184f93a60224a42431a597 2023-11-01 09:54:45,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/74e290407f12419abba9c5e637abc4d0 for inclusion in 2545414ff76df89ec2e286e567bebe0f/family1 2023-11-01 09:54:45,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/303786a37b334f4b9826c132880037fb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/303786a37b334f4b9826c132880037fb 2023-11-01 09:54:45,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/632cf80ae1264fa8954f33ebac5087a4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/632cf80ae1264fa8954f33ebac5087a4 2023-11-01 09:54:45,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-01 09:54:45,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:45,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:45,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/696a868b2c864ed2b5dec489b21ee2f3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/696a868b2c864ed2b5dec489b21ee2f3 2023-11-01 09:54:45,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/74e290407f12419abba9c5e637abc4d0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8gjrtgq92r5e14enmf8fsdvjd9r6ks6h9ead81ioehednpudcigs532hvsqa81jc/family1/74e290407f12419abba9c5e637abc4d0 2023-11-01 09:54:45,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/233825b433fa4a18adaedddda87b8118 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/233825b433fa4a18adaedddda87b8118 2023-11-01 09:54:45,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8gjrtgq92r5e14enmf8fsdvjd9r6ks6h9ead81ioehednpudcigs532hvsqa81jc/family1/74e290407f12419abba9c5e637abc4d0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_ 2023-11-01 09:54:45,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d56161b9de6a41a580e62e547e709d18 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d56161b9de6a41a580e62e547e709d18 2023-11-01 09:54:45,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8gjrtgq92r5e14enmf8fsdvjd9r6ks6h9ead81ioehednpudcigs532hvsqa81jc/family1/74e290407f12419abba9c5e637abc4d0 into 2545414ff76df89ec2e286e567bebe0f/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_ - updating store file list. 2023-11-01 09:54:45,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d007ea568e2a4e008b3f0d888d8e7a1c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/d007ea568e2a4e008b3f0d888d8e7a1c 2023-11-01 09:54:45,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/bf42425224664147b7ef631be9db17bc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/bf42425224664147b7ef631be9db17bc 2023-11-01 09:54:45,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/7ecbbb864a9e45a1b163b5d74a99e036 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/7ecbbb864a9e45a1b163b5d74a99e036 2023-11-01 09:54:45,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_ into 2545414ff76df89ec2e286e567bebe0f/family1 2023-11-01 09:54:45,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8gjrtgq92r5e14enmf8fsdvjd9r6ks6h9ead81ioehednpudcigs532hvsqa81jc/family1/74e290407f12419abba9c5e637abc4d0 into 2545414ff76df89ec2e286e567bebe0f/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_) 2023-11-01 09:54:45,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/ad1da5e275284b35b5496ceded87dc48_SeqId_44_ 2023-11-01 09:54:45,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8gjrtgq92r5e14enmf8fsdvjd9r6ks6h9ead81ioehednpudcigs532hvsqa81jc/family1/74e290407f12419abba9c5e637abc4d0 2023-11-01 09:54:45,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:54:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:54:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 2545414ff76df89ec2e286e567bebe0f/family1 is initiating minor compaction (all files) 2023-11-01 09:54:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@319841c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:45,973 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2545414ff76df89ec2e286e567bebe0f/family1 in testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:54:45,974 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/02f9923e6ead45bc80b5cf6593f609fd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/67c1aba948924318b67d5ace6bbe5307, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp, totalSize=337.0 K 2023-11-01 09:54:45,974 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 02f9923e6ead45bc80b5cf6593f609fd, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:54:45,974 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 67c1aba948924318b67d5ace6bbe5307, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:54:45,975 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878856338 2023-11-01 09:54:45,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:45,976 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:45,978 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307a0a397e9429430287defc280749f4b4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307a0a397e9429430287defc280749f4b4 2023-11-01 09:54:45,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d01693ba60274158a48cfeb016cea96b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d01693ba60274158a48cfeb016cea96b 2023-11-01 09:54:45,980 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053a00cde576dc457a98a3ef4b97057e27 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053a00cde576dc457a98a3ef4b97057e27 2023-11-01 09:54:45,980 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-01 09:54:45,980 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-01 09:54:45,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-01 09:54:45,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-01 09:54:45,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:45,982 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:54:45,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8320 sec 2023-11-01 09:54:46,008 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:54:46,008 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ab5c14d to 127.0.0.1:49762 2023-11-01 09:54:46,008 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:54:46,009 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:54:46,009 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x729a806a to 127.0.0.1:49762 2023-11-01 09:54:46,009 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:54:46,009 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:54:46,009 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e8849f1 to 127.0.0.1:49762 2023-11-01 09:54:46,009 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:54:46,009 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:54:46,009 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f47bf1f to 127.0.0.1:49762 2023-11-01 09:54:46,009 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:54:46,009 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:54:46,010 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6db52bea to 127.0.0.1:49762 2023-11-01 09:54:46,010 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:54:46,014 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2545414ff76df89ec2e286e567bebe0f#family1#compaction#50 average throughput is 5.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:54:46,099 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264 (was 258) - Thread LEAK? -, OpenFileDescriptor=621 (was 609) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 311), ProcessCount=169 (was 169), AvailableMemoryMB=10607 (was 10714) 2023-11-01 09:54:46,111 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=264, OpenFileDescriptor=621, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=169, AvailableMemoryMB=10607 2023-11-01 09:54:46,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-01 09:54:46,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:46,115 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:54:46,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-01 09:54:46,116 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:54:46,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-01 09:54:46,117 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:46,117 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c empty. 2023-11-01 09:54:46,118 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:46,118 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-01 09:54:46,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-01 09:54:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-01 09:54:46,525 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:46,526 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => a64472f1d773fc81816fad418927b98c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:54:46,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-01 09:54:46,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:46,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing a64472f1d773fc81816fad418927b98c, disabling compactions & flushes 2023-11-01 09:54:46,932 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:46,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:46,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. after waiting 0 ms 2023-11-01 09:54:46,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:46,932 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:46,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:46,934 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:54:46,935 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832486935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832486935"}]},"ts":"1698832486935"} 2023-11-01 09:54:46,936 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:54:46,937 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:54:46,937 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832486937"}]},"ts":"1698832486937"} 2023-11-01 09:54:46,938 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-01 09:54:46,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, ASSIGN}] 2023-11-01 09:54:46,942 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, ASSIGN 2023-11-01 09:54:46,943 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:54:47,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:47,094 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832487094"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832487094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832487094"}]},"ts":"1698832487094"} 2023-11-01 09:54:47,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:47,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-01 09:54:47,233 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/.tmp/family1/0842a9667bb2405a83898a246cb7f0cc as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/0842a9667bb2405a83898a246cb7f0cc 2023-11-01 09:54:47,237 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2545414ff76df89ec2e286e567bebe0f/family1 of 2545414ff76df89ec2e286e567bebe0f into 0842a9667bb2405a83898a246cb7f0cc(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:54:47,237 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:54:47,238 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698832485973; duration=1sec 2023-11-01 09:54:47,238 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:47,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/02f9923e6ead45bc80b5cf6593f609fd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/67c1aba948924318b67d5ace6bbe5307, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_] to archive 2023-11-01 09:54:47,248 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:47,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:47,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:47,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/02f9923e6ead45bc80b5cf6593f609fd to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/02f9923e6ead45bc80b5cf6593f609fd 2023-11-01 09:54:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a64472f1d773fc81816fad418927b98c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:54:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:54:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/67c1aba948924318b67d5ace6bbe5307 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/67c1aba948924318b67d5ace6bbe5307 2023-11-01 09:54:47,253 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/family1/6faf8d11d20e409c9f4025ef81f14bff_SeqId_47_ 2023-11-01 09:54:47,254 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:54:47,254 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:54:47,254 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a64472f1d773fc81816fad418927b98c columnFamilyName family1 2023-11-01 09:54:47,256 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(310): Store=a64472f1d773fc81816fad418927b98c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:54:47,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:47,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:54:47,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a64472f1d773fc81816fad418927b98c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60401501, jitterRate=-0.0999474972486496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:54:47,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:47,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., pid=41, masterSystemTime=1698832487248 2023-11-01 09:54:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:47,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:47,263 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:47,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832487263"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832487263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832487263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832487263"}]},"ts":"1698832487263"} 2023-11-01 09:54:47,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-01 09:54:47,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817 in 169 msec 2023-11-01 09:54:47,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-01 09:54:47,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, ASSIGN in 325 msec 2023-11-01 09:54:47,268 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:54:47,268 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832487268"}]},"ts":"1698832487268"} 2023-11-01 09:54:47,270 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-01 09:54:47,272 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:54:47,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1590 sec 2023-11-01 09:54:48,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-01 09:54:48,221 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-01 09:54:48,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:48,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,242 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:48,242 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:48,242 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:48,242 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:48,243 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,243 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,244 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:48,244 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:48,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:48,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:48,245 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:48,245 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:48,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,246 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,246 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:48,246 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:48,246 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:48,246 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:48,246 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:48,246 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:48,246 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:48,246 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:48,247 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:54:48,511 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:48,667 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306077daafe90040cdabcd23714cfc2d20 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511306077daafe90040cdabcd23714cfc2d20 2023-11-01 09:54:49,071 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/016f2146fd1041909968a61eb8046b4a 2023-11-01 09:54:49,076 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/016f2146fd1041909968a61eb8046b4a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/016f2146fd1041909968a61eb8046b4a 2023-11-01 09:54:49,080 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/016f2146fd1041909968a61eb8046b4a, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-01 09:54:49,081 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 834ms, sequenceid=5, compaction requested=false 2023-11-01 09:54:49,081 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:49,081 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:49,083 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,083 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:49,083 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:49,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:49,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e6f012f[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:49,085 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:49,085 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,087 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:49,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:49,087 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:49,087 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,087 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:49,088 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:49,088 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,088 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:49,088 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:49,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:49,091 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,091 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:49,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:49,092 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:49,093 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,094 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:49,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:49,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:49,096 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:49,096 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:49,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:49,197 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:49,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:49,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:49,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:49,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,202 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:49,202 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:49,203 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:49,203 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:49,203 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,203 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,205 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,205 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:49,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:49,205 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:49,205 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:49,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,206 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:49,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:49,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:49,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:49,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:49,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:49,207 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:49,207 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:49,207 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:54:49,618 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112887f09cd8496149dd8a9f838e84ce8f0d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112887f09cd8496149dd8a9f838e84ce8f0d 2023-11-01 09:54:50,024 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/eb9fc6b8713047d5b566e856a143797b 2023-11-01 09:54:50,029 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/eb9fc6b8713047d5b566e856a143797b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/eb9fc6b8713047d5b566e856a143797b 2023-11-01 09:54:50,034 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/eb9fc6b8713047d5b566e856a143797b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:54:50,034 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 827ms, sequenceid=9, compaction requested=false 2023-11-01 09:54:50,034 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:50,035 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:50,035 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:50,036 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,036 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:50,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:50,037 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:50,037 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b11b931[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:50,038 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:50,038 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,039 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,039 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:50,039 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:50,039 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:50,039 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,039 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:50,040 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:50,040 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,041 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:50,041 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:50,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:50,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:50,043 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,043 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:50,046 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,046 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,046 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:50,046 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,047 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:50,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,053 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:50,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:50,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:50,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:50,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:50,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,053 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:50,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:50,054 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:50,054 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:50,154 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:50,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:50,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:50,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:50,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,160 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:50,160 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:50,160 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:50,160 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:50,160 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,161 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,162 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,162 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:50,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:50,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:50,162 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,162 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:50,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,163 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:50,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:50,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:50,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:50,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:50,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:50,163 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:50,163 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:50,163 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:50,575 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120142014f1884cd4bbb96b742ca9992c0cb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120142014f1884cd4bbb96b742ca9992c0cb 2023-11-01 09:54:50,980 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/e83527d4b5014e0487a2b2cb35af59b9 2023-11-01 09:54:50,985 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/e83527d4b5014e0487a2b2cb35af59b9 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/e83527d4b5014e0487a2b2cb35af59b9 2023-11-01 09:54:50,989 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/e83527d4b5014e0487a2b2cb35af59b9, entries=1, sequenceid=13, filesize=5.0 K 2023-11-01 09:54:50,989 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 826ms, sequenceid=13, compaction requested=true 2023-11-01 09:54:50,990 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:50,990 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:50,990 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:50,990 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:50,990 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,990 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:50,990 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:50,992 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,992 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:50,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:50,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:50,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f14275f[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:50,994 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:50,994 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,995 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,995 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:50,995 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:50,995 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:50,995 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,996 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:50,997 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,997 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:50,997 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:50,997 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:50,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:50,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:50,999 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:50,999 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:50,999 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:50,999 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:50,999 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:51,001 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,001 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:51,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,001 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:51,001 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,002 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:51,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:51,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:51,005 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:51,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:51,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:51,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:51,005 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,006 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:51,006 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:51,006 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,006 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,106 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:51,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:51,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:51,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:51,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,112 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:51,112 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:51,112 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:51,112 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:51,112 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,112 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,113 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,113 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:51,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:51,113 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,113 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,114 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:51,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,114 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:51,114 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:51,114 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:51,115 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:51,115 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:51,115 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:51,115 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:51,115 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:51,526 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dd1b6cb1cf7c42179d7396b45832b3db to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dd1b6cb1cf7c42179d7396b45832b3db 2023-11-01 09:54:51,932 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/4d320fb06333444abfb27eb8fc3a3ecd 2023-11-01 09:54:51,936 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/4d320fb06333444abfb27eb8fc3a3ecd as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/4d320fb06333444abfb27eb8fc3a3ecd 2023-11-01 09:54:51,940 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/4d320fb06333444abfb27eb8fc3a3ecd, entries=1, sequenceid=17, filesize=5.0 K 2023-11-01 09:54:51,941 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 826ms, sequenceid=17, compaction requested=true 2023-11-01 09:54:51,941 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:51,941 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:51,941 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:51,941 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:51,941 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,941 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:51,942 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:51,943 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,943 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:51,943 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,943 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:51,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:51,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21c09644[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:51,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:51,945 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,946 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,946 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:51,946 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:51,946 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:51,946 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,946 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:51,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:51,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:51,948 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:51,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:51,950 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:51,950 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:51,950 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:51,950 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,950 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:51,951 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,951 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,952 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:51,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:51,952 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,953 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:51,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:51,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:51,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:51,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:51,955 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:51,955 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:51,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:51,956 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,056 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:52,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:52,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:52,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:52,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,062 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:52,062 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:52,062 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:52,062 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:52,063 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,063 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,064 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,064 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:52,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:52,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:52,064 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,064 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:52,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:52,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,065 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:52,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:52,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:52,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:52,066 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:52,066 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:52,066 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:52,066 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:52,066 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:52,477 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228060be143ef8a46538e9934f44264271b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228060be143ef8a46538e9934f44264271b 2023-11-01 09:54:52,780 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:54:52,882 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/c69b63cd9c864fc190411cf4567e1b81 2023-11-01 09:54:52,887 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/c69b63cd9c864fc190411cf4567e1b81 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/c69b63cd9c864fc190411cf4567e1b81 2023-11-01 09:54:52,891 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/c69b63cd9c864fc190411cf4567e1b81, entries=1, sequenceid=21, filesize=5.0 K 2023-11-01 09:54:52,892 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 826ms, sequenceid=21, compaction requested=true 2023-11-01 09:54:52,892 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:52,892 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:52,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:52,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:52,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:52,892 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:52,897 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,897 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:52,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:52,897 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,897 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:52,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:52,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:52,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:52,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:52,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77708d2a[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:52,898 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:52,898 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,899 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,899 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:52,900 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:52,900 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:52,900 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,900 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:52,902 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:52,902 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:52,902 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,902 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:52,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:52,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:52,904 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:52,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:52,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:52,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,904 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:52,905 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,905 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,905 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:52,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:52,906 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:52,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,907 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:52,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:52,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:52,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:52,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:52,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:52,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:52,909 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:52,909 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,910 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,910 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:52,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:52,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:52,910 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:52,910 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:53,010 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:53,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:53,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:53,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:53,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,016 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:53,016 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:53,016 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:53,016 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:53,016 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,016 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,017 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:53,017 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:53,018 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,018 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,019 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:53,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:53,019 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:53,019 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:53,019 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:53,431 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231aa2d2c8375c24123801425e98c1e7f6c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa2d2c8375c24123801425e98c1e7f6c 2023-11-01 09:54:53,437 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/10b4f4eb80f34970bbae0d112693e9da 2023-11-01 09:54:53,442 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/10b4f4eb80f34970bbae0d112693e9da as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/10b4f4eb80f34970bbae0d112693e9da 2023-11-01 09:54:53,446 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/10b4f4eb80f34970bbae0d112693e9da, entries=1, sequenceid=25, filesize=5.0 K 2023-11-01 09:54:53,447 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 428ms, sequenceid=25, compaction requested=true 2023-11-01 09:54:53,447 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:53,447 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:53,452 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,452 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:53,453 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,453 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:53,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:53,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11ce7ac4[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:53,454 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:53,454 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,455 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,455 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:53,455 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:53,455 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:53,456 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,456 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:53,457 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:53,457 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,457 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:53,457 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:53,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:53,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:53,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:53,459 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:53,459 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:53,459 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:53,459 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,459 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:53,460 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,460 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:53,460 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:53,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:53,461 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:53,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:53,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:53,465 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:53,465 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:53,565 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:53,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:53,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:53,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:53,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,571 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:53,571 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:53,571 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:53,571 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:53,572 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,572 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,573 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:53,573 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:53,573 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:53,573 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:53,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,574 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,574 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:53,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:53,574 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:53,574 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:53,574 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:53,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:53,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:53,575 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:53,575 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:53,575 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:53,989 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c9ce901ad7634ae6b9b9ff02f89f1406 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c9ce901ad7634ae6b9b9ff02f89f1406 2023-11-01 09:54:54,131 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.23076923076923078, tune throughput to 61.54 MB/second 2023-11-01 09:54:54,394 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/1503a8a4f4a94100b288b313b2edb939 2023-11-01 09:54:54,398 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/1503a8a4f4a94100b288b313b2edb939 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/1503a8a4f4a94100b288b313b2edb939 2023-11-01 09:54:54,402 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/1503a8a4f4a94100b288b313b2edb939, entries=1, sequenceid=29, filesize=5.0 K 2023-11-01 09:54:54,403 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 828ms, sequenceid=29, compaction requested=true 2023-11-01 09:54:54,403 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:54,403 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:54,404 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:54,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:54,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:54,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:54,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fee997d[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:54,406 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:54,406 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,412 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,412 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:54,412 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:54,412 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,412 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:54,412 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:54,413 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,413 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:54,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:54,414 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:54,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:54,416 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:54,416 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:54,416 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:54,416 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,416 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:54,423 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,423 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:54,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,423 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:54,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:54,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,424 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:54,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:54,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:54,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:54,427 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:54,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,428 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:54,428 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,428 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:54,428 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:54,528 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:54,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:54,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:54,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:54,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,534 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:54,534 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:54,534 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:54,534 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:54,535 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,535 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,536 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,536 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:54,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:54,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:54,536 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:54,536 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:54,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,537 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,537 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:54,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:54,537 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:54,537 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:54,537 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:54,537 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:54,537 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:54,538 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:54,538 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:54,538 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:54,950 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035df9fd4708d24cadbdeacaf1e3a07357 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035df9fd4708d24cadbdeacaf1e3a07357 2023-11-01 09:54:55,355 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/cf2053d245ed424196cf0e177809eaf2 2023-11-01 09:54:55,361 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/cf2053d245ed424196cf0e177809eaf2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cf2053d245ed424196cf0e177809eaf2 2023-11-01 09:54:55,366 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cf2053d245ed424196cf0e177809eaf2, entries=1, sequenceid=33, filesize=5.0 K 2023-11-01 09:54:55,366 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 828ms, sequenceid=33, compaction requested=true 2023-11-01 09:54:55,366 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:55,367 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:55,368 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,368 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:55,369 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,369 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:55,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:55,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ab94e72[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:55,370 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:55,370 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,371 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,372 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:55,372 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:55,372 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:55,372 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,372 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:55,375 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,375 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:55,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:55,377 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:55,377 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:55,377 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:55,377 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,377 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:55,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:55,379 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:55,379 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,381 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,383 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:55,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:55,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:55,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:55,383 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:55,384 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:55,484 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:55,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:55,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,490 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:55,490 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:55,490 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:55,490 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:55,490 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,491 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,492 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:55,492 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:55,493 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:55,493 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,494 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,494 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:55,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:55,494 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:55,494 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:55,494 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:55,910 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e5d3017364fe4175908f9d3937e43c41 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907e5d3017364fe4175908f9d3937e43c41 2023-11-01 09:54:56,316 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/fb69513b8a93452999a81898196c0b4e 2023-11-01 09:54:56,320 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/fb69513b8a93452999a81898196c0b4e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/fb69513b8a93452999a81898196c0b4e 2023-11-01 09:54:56,324 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/fb69513b8a93452999a81898196c0b4e, entries=1, sequenceid=37, filesize=5.0 K 2023-11-01 09:54:56,325 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 831ms, sequenceid=37, compaction requested=true 2023-11-01 09:54:56,325 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:56,325 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:56,325 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:56,325 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:56,325 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,326 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:56,326 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:56,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,327 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:56,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,327 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:56,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:56,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49d39dd2[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:56,329 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:56,329 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,330 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:56,330 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,330 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:56,331 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,331 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:56,331 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:56,331 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:56,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:56,334 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:56,334 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:56,334 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:56,334 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,334 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:56,336 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,336 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:56,336 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:56,336 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,338 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:56,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:56,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:56,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-01 09:54:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:56,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,442 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:56,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:56,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:54:56,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-01 09:54:56,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,448 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:56,448 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:56,449 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-01 09:54:56,449 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-01 09:54:56,449 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,449 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,450 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,450 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:56,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:56,450 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:56,450 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:54:56,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:54:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,451 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,451 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-01 09:54:56,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:56,451 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-01 09:54:56,451 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:54:56,451 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-01 09:54:56,451 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:54:56,451 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:54:56,451 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:56,451 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. started... 2023-11-01 09:54:56,452 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a64472f1d773fc81816fad418927b98c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:54:56,863 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c0f06a0453c64e21ac78983c4d9de56f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c0f06a0453c64e21ac78983c4d9de56f 2023-11-01 09:54:57,269 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/cd12964516074aa198f20a7d0270e1ae 2023-11-01 09:54:57,273 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/cd12964516074aa198f20a7d0270e1ae as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cd12964516074aa198f20a7d0270e1ae 2023-11-01 09:54:57,277 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cd12964516074aa198f20a7d0270e1ae, entries=1, sequenceid=41, filesize=5.0 K 2023-11-01 09:54:57,278 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a64472f1d773fc81816fad418927b98c in 826ms, sequenceid=41, compaction requested=true 2023-11-01 09:54:57,278 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:57,278 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:57,278 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:54:57,278 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:54:57,278 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,278 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-01 09:54:57,278 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-01 09:54:57,280 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,280 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:57,281 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:57,281 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:54:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:57,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-01 09:54:57,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b29c676[Count = 0] remaining members to acquire global barrier 2023-11-01 09:54:57,282 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-01 09:54:57,282 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,283 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,283 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-01 09:54:57,283 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-01 09:54:57,283 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:54:57,283 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,284 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:54:57,285 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-01 09:54:57,285 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,285 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:57,285 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-01 09:54:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:57,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:54:57,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-01 09:54:57,287 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-01 09:54:57,287 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:54:57,287 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:54:57,287 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,287 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:54:57,288 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,288 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:54:57,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,289 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:54:57,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:57,289 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:54:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,290 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:54:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:54:57,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:54:57,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:54:57,293 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-01 09:54:57,293 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,294 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:54:57,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:54:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:54:57,394 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:54:57,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:54:57,396 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:57,398 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:57,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:57,399 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833097399 2023-11-01 09:54:57,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:54:57,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-01 09:54:57,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:54:57,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x0a641a84 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:54:57,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d234f0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:54:57,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,245 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030f4d448cf9f74603a212cda6c492dec7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030f4d448cf9f74603a212cda6c492dec7 2023-11-01 09:54:58,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:54:58,259 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:54:58,261 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:54:58,266 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:54:58,268 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:54:58,276 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5c2869087a14bcf818eee62de9c4573 first=Optional[r3] last=Optional[r6] 2023-11-01 09:54:58,276 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5c2869087a14bcf818eee62de9c4573}] 2023-11-01 09:54:58,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5c2869087a14bcf818eee62de9c4573 for inclusion in a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:54:58,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-01 09:54:58,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:58,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d5c2869087a14bcf818eee62de9c4573 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__86a4948oe15tg3fh01mc3ukhuqtnp1edb8tlo5ps8pfqscrh6lbbqt8esr4ma7v/family1/d5c2869087a14bcf818eee62de9c4573 2023-11-01 09:54:58,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__86a4948oe15tg3fh01mc3ukhuqtnp1edb8tlo5ps8pfqscrh6lbbqt8esr4ma7v/family1/d5c2869087a14bcf818eee62de9c4573 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_ 2023-11-01 09:54:58,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__86a4948oe15tg3fh01mc3ukhuqtnp1edb8tlo5ps8pfqscrh6lbbqt8esr4ma7v/family1/d5c2869087a14bcf818eee62de9c4573 into a64472f1d773fc81816fad418927b98c/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_ - updating store file list. 2023-11-01 09:54:58,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_ into a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:54:58,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__86a4948oe15tg3fh01mc3ukhuqtnp1edb8tlo5ps8pfqscrh6lbbqt8esr4ma7v/family1/d5c2869087a14bcf818eee62de9c4573 into a64472f1d773fc81816fad418927b98c/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_) 2023-11-01 09:54:58,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__86a4948oe15tg3fh01mc3ukhuqtnp1edb8tlo5ps8pfqscrh6lbbqt8esr4ma7v/family1/d5c2869087a14bcf818eee62de9c4573 2023-11-01 09:54:58,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:54:58,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:54:58,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): a64472f1d773fc81816fad418927b98c/family1 is initiating minor compaction 2023-11-01 09:54:58,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@71bbc9eb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:58,294 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a64472f1d773fc81816fad418927b98c/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:58,294 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/eb9fc6b8713047d5b566e856a143797b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/e83527d4b5014e0487a2b2cb35af59b9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/4d320fb06333444abfb27eb8fc3a3ecd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/c69b63cd9c864fc190411cf4567e1b81, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/10b4f4eb80f34970bbae0d112693e9da, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/1503a8a4f4a94100b288b313b2edb939, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cf2053d245ed424196cf0e177809eaf2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/fb69513b8a93452999a81898196c0b4e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cd12964516074aa198f20a7d0270e1ae, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp, totalSize=50.4 K 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting eb9fc6b8713047d5b566e856a143797b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting e83527d4b5014e0487a2b2cb35af59b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 4d320fb06333444abfb27eb8fc3a3ecd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting c69b63cd9c864fc190411cf4567e1b81, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 10b4f4eb80f34970bbae0d112693e9da, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 1503a8a4f4a94100b288b313b2edb939, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting cf2053d245ed424196cf0e177809eaf2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting fb69513b8a93452999a81898196c0b4e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:54:58,294 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting cd12964516074aa198f20a7d0270e1ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:54:58,295 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 04cd81fab648475f95a56ddae5466f90_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:54:58,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:54:58,296 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:58,298 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228060be143ef8a46538e9934f44264271b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228060be143ef8a46538e9934f44264271b 2023-11-01 09:54:58,299 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa2d2c8375c24123801425e98c1e7f6c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231aa2d2c8375c24123801425e98c1e7f6c 2023-11-01 09:54:58,301 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c9ce901ad7634ae6b9b9ff02f89f1406 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c9ce901ad7634ae6b9b9ff02f89f1406 2023-11-01 09:54:58,302 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035df9fd4708d24cadbdeacaf1e3a07357 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035df9fd4708d24cadbdeacaf1e3a07357 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-01 09:54:58,302 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,303 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:58,323 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): a64472f1d773fc81816fad418927b98c#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:54:59,138 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/f9b48c8f320e47cb917977fc2ca806f2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/f9b48c8f320e47cb917977fc2ca806f2 2023-11-01 09:54:59,143 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a64472f1d773fc81816fad418927b98c/family1 of a64472f1d773fc81816fad418927b98c into f9b48c8f320e47cb917977fc2ca806f2(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:54:59,143 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:59,143 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698832498294; duration=0sec 2023-11-01 09:54:59,144 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:59,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/eb9fc6b8713047d5b566e856a143797b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/e83527d4b5014e0487a2b2cb35af59b9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/4d320fb06333444abfb27eb8fc3a3ecd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/c69b63cd9c864fc190411cf4567e1b81, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/10b4f4eb80f34970bbae0d112693e9da, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/1503a8a4f4a94100b288b313b2edb939, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cf2053d245ed424196cf0e177809eaf2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/fb69513b8a93452999a81898196c0b4e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cd12964516074aa198f20a7d0270e1ae, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_] to archive 2023-11-01 09:54:59,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:59,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/eb9fc6b8713047d5b566e856a143797b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/eb9fc6b8713047d5b566e856a143797b 2023-11-01 09:54:59,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/e83527d4b5014e0487a2b2cb35af59b9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/e83527d4b5014e0487a2b2cb35af59b9 2023-11-01 09:54:59,161 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120560fcfa53e72c4b078394c6e731643b1d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120560fcfa53e72c4b078394c6e731643b1d 2023-11-01 09:54:59,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:54:59,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/4d320fb06333444abfb27eb8fc3a3ecd to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/4d320fb06333444abfb27eb8fc3a3ecd 2023-11-01 09:54:59,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/c69b63cd9c864fc190411cf4567e1b81 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/c69b63cd9c864fc190411cf4567e1b81 2023-11-01 09:54:59,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/10b4f4eb80f34970bbae0d112693e9da to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/10b4f4eb80f34970bbae0d112693e9da 2023-11-01 09:54:59,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/1503a8a4f4a94100b288b313b2edb939 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/1503a8a4f4a94100b288b313b2edb939 2023-11-01 09:54:59,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cf2053d245ed424196cf0e177809eaf2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cf2053d245ed424196cf0e177809eaf2 2023-11-01 09:54:59,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/fb69513b8a93452999a81898196c0b4e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/fb69513b8a93452999a81898196c0b4e 2023-11-01 09:54:59,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cd12964516074aa198f20a7d0270e1ae to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/cd12964516074aa198f20a7d0270e1ae 2023-11-01 09:54:59,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/04cd81fab648475f95a56ddae5466f90_SeqId_44_ 2023-11-01 09:54:59,188 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aa9ec8ce497448df951bbb662d73948a first=Optional[r00] last=Optional[r2] 2023-11-01 09:54:59,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aa9ec8ce497448df951bbb662d73948a}] 2023-11-01 09:54:59,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aa9ec8ce497448df951bbb662d73948a for inclusion in a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:54:59,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-01 09:54:59,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:54:59,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:54:59,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aa9ec8ce497448df951bbb662d73948a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2fcjum9q7pn4r4m4dgm9ufi1q9il7bvdrlamkp29bg60ulm6csm0t96u130fv789/family1/aa9ec8ce497448df951bbb662d73948a 2023-11-01 09:54:59,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2fcjum9q7pn4r4m4dgm9ufi1q9il7bvdrlamkp29bg60ulm6csm0t96u130fv789/family1/aa9ec8ce497448df951bbb662d73948a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_ 2023-11-01 09:54:59,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2fcjum9q7pn4r4m4dgm9ufi1q9il7bvdrlamkp29bg60ulm6csm0t96u130fv789/family1/aa9ec8ce497448df951bbb662d73948a into a64472f1d773fc81816fad418927b98c/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_ - updating store file list. 2023-11-01 09:54:59,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_ into a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:54:59,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2fcjum9q7pn4r4m4dgm9ufi1q9il7bvdrlamkp29bg60ulm6csm0t96u130fv789/family1/aa9ec8ce497448df951bbb662d73948a into a64472f1d773fc81816fad418927b98c/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_) 2023-11-01 09:54:59,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2fcjum9q7pn4r4m4dgm9ufi1q9il7bvdrlamkp29bg60ulm6csm0t96u130fv789/family1/aa9ec8ce497448df951bbb662d73948a 2023-11-01 09:54:59,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:54:59,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:54:59,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): a64472f1d773fc81816fad418927b98c/family1 is initiating minor compaction (all files) 2023-11-01 09:54:59,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4230a4da; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:54:59,203 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a64472f1d773fc81816fad418927b98c/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:54:59,203 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/016f2146fd1041909968a61eb8046b4a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/f9b48c8f320e47cb917977fc2ca806f2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp, totalSize=390.1 K 2023-11-01 09:54:59,203 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 016f2146fd1041909968a61eb8046b4a, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:54:59,204 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting f9b48c8f320e47cb917977fc2ca806f2, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:54:59,204 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting dc9629eb6b654fe4bcf883ead0629098_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878856338 2023-11-01 09:54:59,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:54:59,205 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:54:59,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511306077daafe90040cdabcd23714cfc2d20 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511306077daafe90040cdabcd23714cfc2d20 2023-11-01 09:54:59,207 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120142014f1884cd4bbb96b742ca9992c0cb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120142014f1884cd4bbb96b742ca9992c0cb 2023-11-01 09:54:59,208 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dd1b6cb1cf7c42179d7396b45832b3db to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dd1b6cb1cf7c42179d7396b45832b3db 2023-11-01 09:54:59,209 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-01 09:54:59,209 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-01 09:54:59,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:54:59,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:54:59,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:54:59,210 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:54:59,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8140 sec 2023-11-01 09:54:59,222 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): a64472f1d773fc81816fad418927b98c#family1#compaction#62 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:54:59,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-01 09:54:59,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:54:59,287 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-01 09:54:59,288 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-01 09:54:59,288 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-01 09:54:59,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-01 09:54:59,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE}] 2023-11-01 09:54:59,292 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE 2023-11-01 09:54:59,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:59,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832499293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832499293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832499293"}]},"ts":"1698832499293"} 2023-11-01 09:54:59,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:54:59,446 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:54:59,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a64472f1d773fc81816fad418927b98c 2023-11-01 09:54:59,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a64472f1d773fc81816fad418927b98c, disabling compactions & flushes 2023-11-01 09:54:59,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,438 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/.tmp/family1/d3ebf60c437a438ca63831aaf05ccb30 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/d3ebf60c437a438ca63831aaf05ccb30 2023-11-01 09:55:00,443 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a64472f1d773fc81816fad418927b98c/family1 of a64472f1d773fc81816fad418927b98c into d3ebf60c437a438ca63831aaf05ccb30(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:00,443 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:55:00,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,443 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698832499202; duration=1sec 2023-11-01 09:55:00,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,443 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:00,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. after waiting 0 ms 2023-11-01 09:55:00,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/016f2146fd1041909968a61eb8046b4a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/f9b48c8f320e47cb917977fc2ca806f2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_] to archive 2023-11-01 09:55:00,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:00,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/016f2146fd1041909968a61eb8046b4a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/016f2146fd1041909968a61eb8046b4a 2023-11-01 09:55:00,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/f9b48c8f320e47cb917977fc2ca806f2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/f9b48c8f320e47cb917977fc2ca806f2 2023-11-01 09:55:00,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/dc9629eb6b654fe4bcf883ead0629098_SeqId_47_ 2023-11-01 09:55:00,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-01 09:55:00,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:55:00,454 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: a64472f1d773fc81816fad418927b98c to self. 2023-11-01 09:55:00,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,455 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=CLOSED 2023-11-01 09:55:00,456 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832500455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832500455"}]},"ts":"1698832500455"} 2023-11-01 09:55:00,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-01 09:55:00,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817 in 1.1630 sec 2023-11-01 09:55:00,458 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=true 2023-11-01 09:55:00,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:00,609 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832500609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832500609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832500609"}]},"ts":"1698832500609"} 2023-11-01 09:55:00,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:00,762 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:00,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a64472f1d773fc81816fad418927b98c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:55:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,766 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,767 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:55:00,767 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:55:00,767 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a64472f1d773fc81816fad418927b98c columnFamilyName family1 2023-11-01 09:55:00,772 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/d3ebf60c437a438ca63831aaf05ccb30 2023-11-01 09:55:00,772 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(310): Store=a64472f1d773fc81816fad418927b98c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:00,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:00,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a64472f1d773fc81816fad418927b98c; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74665675, jitterRate=0.1126052588224411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:55:00,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:55:00,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., pid=47, masterSystemTime=1698832500762 2023-11-01 09:55:00,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:00,779 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:00,780 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832500779"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832500779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832500779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832500779"}]},"ts":"1698832500779"} 2023-11-01 09:55:00,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-01 09:55:00,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817 in 171 msec 2023-11-01 09:55:00,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-01 09:55:00,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE in 1.4910 sec 2023-11-01 09:55:00,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-01 09:55:00,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4950 sec 2023-11-01 09:55:00,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5080 sec 2023-11-01 09:55:00,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-01 09:55:00,789 INFO [Listener at localhost/37085] compactions.TestMobCompactor(278): alter status finished 2023-11-01 09:55:00,790 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:55:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:55:00,792 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:55:00,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:00,793 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833100793 2023-11-01 09:55:00,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:55:00,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-01 09:55:00,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:55:00,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x17209172 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:00,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@402cefbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:00,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:00,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:00,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:00,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:00,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:01,626 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b5e8541d35e9438dbd49fa3b904e5bbb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b5e8541d35e9438dbd49fa3b904e5bbb 2023-11-01 09:55:01,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:55:01,640 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:01,641 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:01,647 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:55:01,648 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:55:01,656 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0485f0b8afc34e55b9cf8cd955480deb first=Optional[r05] last=Optional[r8] 2023-11-01 09:55:01,656 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0485f0b8afc34e55b9cf8cd955480deb}] 2023-11-01 09:55:01,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0485f0b8afc34e55b9cf8cd955480deb for inclusion in a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:55:01,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-01 09:55:01,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:55:01,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:55:01,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0485f0b8afc34e55b9cf8cd955480deb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5n3du9igenvpf23cpc61bvgt0v180ffa7h66r9ej76g67orlm27hbs2k2vi96c9q/family1/0485f0b8afc34e55b9cf8cd955480deb 2023-11-01 09:55:01,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5n3du9igenvpf23cpc61bvgt0v180ffa7h66r9ej76g67orlm27hbs2k2vi96c9q/family1/0485f0b8afc34e55b9cf8cd955480deb as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/295a57525dc840fb82be711b09c432cd_SeqId_53_ 2023-11-01 09:55:01,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5n3du9igenvpf23cpc61bvgt0v180ffa7h66r9ej76g67orlm27hbs2k2vi96c9q/family1/0485f0b8afc34e55b9cf8cd955480deb into a64472f1d773fc81816fad418927b98c/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/295a57525dc840fb82be711b09c432cd_SeqId_53_ - updating store file list. 2023-11-01 09:55:01,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/295a57525dc840fb82be711b09c432cd_SeqId_53_ into a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:55:01,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5n3du9igenvpf23cpc61bvgt0v180ffa7h66r9ej76g67orlm27hbs2k2vi96c9q/family1/0485f0b8afc34e55b9cf8cd955480deb into a64472f1d773fc81816fad418927b98c/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/295a57525dc840fb82be711b09c432cd_SeqId_53_) 2023-11-01 09:55:01,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5n3du9igenvpf23cpc61bvgt0v180ffa7h66r9ej76g67orlm27hbs2k2vi96c9q/family1/0485f0b8afc34e55b9cf8cd955480deb 2023-11-01 09:55:01,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:55:01,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:01,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c0f06a0453c64e21ac78983c4d9de56f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c0f06a0453c64e21ac78983c4d9de56f 2023-11-01 09:55:01,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112887f09cd8496149dd8a9f838e84ce8f0d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112887f09cd8496149dd8a9f838e84ce8f0d 2023-11-01 09:55:01,675 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-01 09:55:01,675 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-01 09:55:01,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:01,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:01,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:01,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:55:01,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:01,677 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:55:01,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 886 msec 2023-11-01 09:55:01,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-01 09:55:01,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:55:02,143 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-01 09:55:02,144 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-01 09:55:02,144 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-01 09:55:02,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-01 09:55:02,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE}] 2023-11-01 09:55:02,149 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE 2023-11-01 09:55:02,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:02,150 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832502150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832502150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832502150"}]},"ts":"1698832502150"} 2023-11-01 09:55:02,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:02,303 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:02,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a64472f1d773fc81816fad418927b98c, disabling compactions & flushes 2023-11-01 09:55:02,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. after waiting 0 ms 2023-11-01 09:55:02,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-01 09:55:02,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:55:02,309 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: a64472f1d773fc81816fad418927b98c to self. 2023-11-01 09:55:02,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,311 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=CLOSED 2023-11-01 09:55:02,311 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832502311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832502311"}]},"ts":"1698832502311"} 2023-11-01 09:55:02,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-01 09:55:02,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817 in 160 msec 2023-11-01 09:55:02,314 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=true 2023-11-01 09:55:02,464 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:02,465 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832502464"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832502464"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832502464"}]},"ts":"1698832502464"} 2023-11-01 09:55:02,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:02,617 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:02,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a64472f1d773fc81816fad418927b98c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:55:02,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:02,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,622 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,623 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:55:02,623 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1 2023-11-01 09:55:02,623 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a64472f1d773fc81816fad418927b98c columnFamilyName family1 2023-11-01 09:55:02,629 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/295a57525dc840fb82be711b09c432cd_SeqId_53_ 2023-11-01 09:55:02,631 DEBUG [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/family1/d3ebf60c437a438ca63831aaf05ccb30 2023-11-01 09:55:02,632 INFO [StoreOpener-a64472f1d773fc81816fad418927b98c-1] regionserver.HStore(310): Store=a64472f1d773fc81816fad418927b98c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:02,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a64472f1d773fc81816fad418927b98c 2023-11-01 09:55:02,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a64472f1d773fc81816fad418927b98c; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72723442, jitterRate=0.08366373181343079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:55:02,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:55:02,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c., pid=53, masterSystemTime=1698832502617 2023-11-01 09:55:02,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:55:02,639 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a64472f1d773fc81816fad418927b98c, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:02,639 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698832502639"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832502639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832502639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832502639"}]},"ts":"1698832502639"} 2023-11-01 09:55:02,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-01 09:55:02,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure a64472f1d773fc81816fad418927b98c, server=jenkins-hbase4.apache.org,40233,1698832432817 in 174 msec 2023-11-01 09:55:02,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-01 09:55:02,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a64472f1d773fc81816fad418927b98c, REOPEN/MOVE in 492 msec 2023-11-01 09:55:02,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-01 09:55:02,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-11-01 09:55:02,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 911 msec 2023-11-01 09:55:02,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-01 09:55:02,648 INFO [Listener at localhost/37085] compactions.TestMobCompactor(278): alter status finished 2023-11-01 09:55:02,649 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-01 09:55:02,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:55:02,651 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:55:02,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:02,651 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833102651 2023-11-01 09:55:02,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:55:02,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-01 09:55:02,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:55:02,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x61f17177 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:02,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@468723fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-01 09:55:02,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-01 09:55:02,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:02,659 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-01 09:55:02,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-11-01 09:55:02,708 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=244 (was 264), OpenFileDescriptor=611 (was 621), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 263), ProcessCount=169 (was 169), AvailableMemoryMB=10580 (was 10607) 2023-11-01 09:55:02,719 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=169, AvailableMemoryMB=10579 2023-11-01 09:55:02,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-01 09:55:02,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:02,723 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:55:02,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-01 09:55:02,723 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:55:02,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-01 09:55:02,724 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:02,725 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e empty. 2023-11-01 09:55:02,725 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:02,725 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-01 09:55:02,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-01 09:55:03,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-01 09:55:03,133 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-01 09:55:03,134 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4a0560c30c274df40af64b053783ad7e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:03,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-01 09:55:03,542 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:03,542 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 4a0560c30c274df40af64b053783ad7e, disabling compactions & flushes 2023-11-01 09:55:03,542 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,542 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,542 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. after waiting 0 ms 2023-11-01 09:55:03,542 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,542 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,542 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:03,544 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:55:03,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832503545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832503545"}]},"ts":"1698832503545"} 2023-11-01 09:55:03,546 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:55:03,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:55:03,547 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832503547"}]},"ts":"1698832503547"} 2023-11-01 09:55:03,548 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-01 09:55:03,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, ASSIGN}] 2023-11-01 09:55:03,552 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, ASSIGN 2023-11-01 09:55:03,553 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:03,704 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:03,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832503703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832503703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832503703"}]},"ts":"1698832503703"} 2023-11-01 09:55:03,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:03,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-01 09:55:03,857 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:03,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a0560c30c274df40af64b053783ad7e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:55:03,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:03,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,861 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,862 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:03,862 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:03,862 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a0560c30c274df40af64b053783ad7e columnFamilyName family1 2023-11-01 09:55:03,864 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(310): Store=4a0560c30c274df40af64b053783ad7e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:03,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:03,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:03,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a0560c30c274df40af64b053783ad7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73214042, jitterRate=0.09097424149513245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:55:03,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:03,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., pid=57, masterSystemTime=1698832503857 2023-11-01 09:55:03,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:03,872 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:03,872 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832503872"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832503872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832503872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832503872"}]},"ts":"1698832503872"} 2023-11-01 09:55:03,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-01 09:55:03,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817 in 168 msec 2023-11-01 09:55:03,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-01 09:55:03,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, ASSIGN in 324 msec 2023-11-01 09:55:03,876 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:55:03,876 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832503876"}]},"ts":"1698832503876"} 2023-11-01 09:55:03,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-01 09:55:03,880 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:55:03,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1600 sec 2023-11-01 09:55:04,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-01 09:55:04,828 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-01 09:55:04,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:04,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,846 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:04,846 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:04,846 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:04,846 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:04,847 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,847 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,848 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:04,848 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:04,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:04,848 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:04,848 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,849 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:04,849 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:04,849 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:04,850 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:04,850 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:04,850 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:04,850 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:04,850 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:04,850 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:55:05,280 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306e59d7a7e4c34af28261780e0e9634ef to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306e59d7a7e4c34af28261780e0e9634ef 2023-11-01 09:55:05,684 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/e0b90645a1414ced825fea9ff1481596 2023-11-01 09:55:05,688 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/e0b90645a1414ced825fea9ff1481596 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e0b90645a1414ced825fea9ff1481596 2023-11-01 09:55:05,693 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e0b90645a1414ced825fea9ff1481596, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-01 09:55:05,693 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 843ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:05,693 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:05,694 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:05,694 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:05,694 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:05,694 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:05,694 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,694 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:05,694 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:05,695 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:05,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:05,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:05,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40e7971f[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:05,697 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:05,697 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,698 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:05,699 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:05,699 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,699 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:05,701 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:05,701 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:05,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:05,703 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:05,703 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:05,703 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:05,703 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,703 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:05,705 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,705 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:05,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,705 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:05,705 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,706 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,711 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,711 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:05,711 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,711 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:05,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:05,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:05,711 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:05,711 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:05,711 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,712 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,712 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,712 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:05,712 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,712 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:05,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:05,812 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:05,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:05,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:05,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:05,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,818 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:05,818 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:05,818 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:05,818 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:05,818 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,818 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,821 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,821 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:05,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:05,821 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:05,821 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,822 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,822 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:05,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:05,822 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:05,822 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:05,822 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:05,823 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:05,823 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:05,823 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:05,823 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:05,823 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:55:05,981 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:55:06,235 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128859275e7ef254d87870e38321ad0ceb5 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128859275e7ef254d87870e38321ad0ceb5 2023-11-01 09:55:06,513 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-01 09:55:06,640 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/969d589b6ad740adbea44312907f18ba 2023-11-01 09:55:06,645 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/969d589b6ad740adbea44312907f18ba as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/969d589b6ad740adbea44312907f18ba 2023-11-01 09:55:06,648 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/969d589b6ad740adbea44312907f18ba, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:55:06,649 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 826ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:06,649 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:06,649 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:06,651 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,651 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:06,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:06,651 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,651 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:06,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:06,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:06,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@305d9baf[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:06,653 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:06,653 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,654 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,654 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:06,654 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:06,654 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:06,654 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,654 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:06,655 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:06,655 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:06,655 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,655 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:06,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:06,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:06,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:06,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:06,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:06,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:06,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:06,658 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:06,658 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:06,658 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:06,658 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,658 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:06,660 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,660 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,660 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:06,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:06,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:06,660 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:06,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,662 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:06,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:06,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:06,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:06,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:06,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:06,664 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:06,664 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:06,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:06,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:06,764 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:06,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:06,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:06,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:06,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,770 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:06,770 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:06,770 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:06,770 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:06,771 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,771 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,772 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:06,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:06,772 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:06,772 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,773 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,773 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:06,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:06,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:06,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:06,773 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:06,774 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:06,774 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:06,774 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:06,774 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:07,185 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d2b141748f724023bbacab3e6a5a6860 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d2b141748f724023bbacab3e6a5a6860 2023-11-01 09:55:07,590 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/f8ea5fe2d80648a9835638205c6b23b8 2023-11-01 09:55:07,594 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/f8ea5fe2d80648a9835638205c6b23b8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f8ea5fe2d80648a9835638205c6b23b8 2023-11-01 09:55:07,598 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f8ea5fe2d80648a9835638205c6b23b8, entries=1, sequenceid=13, filesize=5.0 K 2023-11-01 09:55:07,598 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 824ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:07,599 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:07,599 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:07,600 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:07,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:07,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:07,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6535bd7b[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:07,602 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:07,602 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,604 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:07,604 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:07,604 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:07,606 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:07,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:07,608 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:07,608 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:07,608 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:07,608 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,608 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:07,610 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,610 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:07,610 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,610 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:07,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,611 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:07,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:07,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,613 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:07,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:07,614 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:07,613 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:07,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:07,614 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,614 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,714 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:07,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:07,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:07,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:07,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,719 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:07,719 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:07,719 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:07,719 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:07,720 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,720 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,721 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,721 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:07,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:07,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:07,721 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:07,721 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:07,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:07,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,722 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,722 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:07,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:07,722 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:07,722 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:07,722 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:07,722 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:07,722 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:07,722 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:08,133 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d2f3a38ba56d41c4921f0c23f74c9d07 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d2f3a38ba56d41c4921f0c23f74c9d07 2023-11-01 09:55:08,539 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/e96d60c7a43240438ee0bdfdc57842fd 2023-11-01 09:55:08,543 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/e96d60c7a43240438ee0bdfdc57842fd as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e96d60c7a43240438ee0bdfdc57842fd 2023-11-01 09:55:08,547 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e96d60c7a43240438ee0bdfdc57842fd, entries=1, sequenceid=17, filesize=5.0 K 2023-11-01 09:55:08,548 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 826ms, sequenceid=17, compaction requested=true 2023-11-01 09:55:08,548 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:08,548 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:08,549 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,549 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:08,549 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:08,551 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:08,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:08,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:08,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4acddd[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:08,553 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:08,553 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:08,558 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,558 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:08,559 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:08,559 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:08,559 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,559 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:08,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:08,561 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:08,561 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:08,561 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:08,561 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,561 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:08,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:08,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:08,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:08,564 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,565 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,567 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:08,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:08,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:08,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:08,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:08,568 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:08,568 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:08,567 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:08,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:08,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:08,568 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,668 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:08,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:08,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,673 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:08,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:08,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:08,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:08,674 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,674 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,675 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:08,675 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:08,675 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:08,675 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,676 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,676 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:08,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:08,676 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:08,676 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:08,676 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:08,676 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:08,677 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:08,677 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:08,677 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:08,677 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:09,088 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122815e0f007344346f7af991ae26da8041d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122815e0f007344346f7af991ae26da8041d 2023-11-01 09:55:09,493 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/af467fbc561842deae55b32465008a84 2023-11-01 09:55:09,499 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/af467fbc561842deae55b32465008a84 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/af467fbc561842deae55b32465008a84 2023-11-01 09:55:09,503 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/af467fbc561842deae55b32465008a84, entries=1, sequenceid=21, filesize=5.0 K 2023-11-01 09:55:09,504 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 827ms, sequenceid=21, compaction requested=true 2023-11-01 09:55:09,504 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:09,504 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:09,506 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,506 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:09,506 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,506 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ce9eda4[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:09,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:09,507 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,509 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,510 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:09,510 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:09,510 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:09,510 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,510 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:09,511 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:09,513 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:09,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:09,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:09,513 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,513 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:09,515 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,515 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:09,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,515 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:09,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:09,515 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,516 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:09,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:09,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:09,518 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,518 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,519 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,519 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:09,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:09,519 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:09,519 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,619 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:09,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:09,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:09,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:09,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,624 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:09,625 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:09,625 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:09,625 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:09,625 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,625 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,627 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,627 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:09,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:09,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:09,627 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:09,627 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:09,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:09,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,628 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,628 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:09,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:09,628 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:09,628 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:09,628 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:09,628 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:09,628 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:09,628 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:09,628 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:09,628 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:10,040 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318d70f81c20844e0bbab61fff35860b7b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318d70f81c20844e0bbab61fff35860b7b 2023-11-01 09:55:10,446 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/66cf232e9aab4a8c8bdad2c34231509b 2023-11-01 09:55:10,453 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/66cf232e9aab4a8c8bdad2c34231509b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/66cf232e9aab4a8c8bdad2c34231509b 2023-11-01 09:55:10,457 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/66cf232e9aab4a8c8bdad2c34231509b, entries=1, sequenceid=25, filesize=5.0 K 2023-11-01 09:55:10,458 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 830ms, sequenceid=25, compaction requested=true 2023-11-01 09:55:10,458 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:10,458 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:10,458 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:10,458 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:10,458 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,458 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:10,458 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:10,459 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,459 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:10,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:10,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20358175[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:10,461 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:10,461 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,462 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:10,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:10,463 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:10,463 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,463 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:10,463 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:10,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:10,465 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:10,465 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:10,465 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:10,466 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,466 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:10,472 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,472 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,473 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:10,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:10,473 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,474 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,483 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,483 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:10,483 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:10,483 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:10,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:10,483 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:10,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:10,483 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,483 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:10,484 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:10,484 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,484 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:10,484 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:10,484 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,584 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:10,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:10,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:10,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,589 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:10,589 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:10,589 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:10,589 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:10,590 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,590 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,594 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:10,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:10,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:10,595 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:10,595 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:10,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:10,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,595 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:10,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:10,596 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:10,596 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:10,596 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:11,010 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c051a2bf17f941dfa5e6a1468c282616 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c051a2bf17f941dfa5e6a1468c282616 2023-11-01 09:55:11,415 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/061bb76faeac4a338545b76acbdd697b 2023-11-01 09:55:11,420 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/061bb76faeac4a338545b76acbdd697b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/061bb76faeac4a338545b76acbdd697b 2023-11-01 09:55:11,424 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/061bb76faeac4a338545b76acbdd697b, entries=1, sequenceid=29, filesize=5.0 K 2023-11-01 09:55:11,425 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 829ms, sequenceid=29, compaction requested=true 2023-11-01 09:55:11,425 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:11,425 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:11,425 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:11,425 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:11,425 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,425 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:11,425 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:11,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,426 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,427 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:11,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:11,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68a33e6d[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:11,428 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:11,428 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,429 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:11,430 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,430 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:11,431 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:11,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:11,433 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:11,433 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:11,433 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:11,433 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,433 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,435 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:11,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:11,436 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,437 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,439 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:11,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:11,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:11,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:11,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:11,439 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:11,440 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:11,540 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:11,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:11,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:11,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:11,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,546 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:11,546 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:11,546 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:11,546 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:11,546 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,546 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,547 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,547 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:11,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:11,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:11,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,549 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:11,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:11,549 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:11,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:11,557 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:11,557 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:11,557 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:11,557 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:11,972 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038521bcff0f0f4bf5b56f9d5f4db26680 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038521bcff0f0f4bf5b56f9d5f4db26680 2023-11-01 09:55:12,377 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/ef5fed720c8d4aa6b4364b7212e13cdb 2023-11-01 09:55:12,381 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/ef5fed720c8d4aa6b4364b7212e13cdb as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/ef5fed720c8d4aa6b4364b7212e13cdb 2023-11-01 09:55:12,385 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/ef5fed720c8d4aa6b4364b7212e13cdb, entries=1, sequenceid=33, filesize=5.0 K 2023-11-01 09:55:12,386 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 829ms, sequenceid=33, compaction requested=true 2023-11-01 09:55:12,386 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:12,386 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:12,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:12,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:12,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:12,386 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:12,387 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,387 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:12,388 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:12,388 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:12,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:12,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e513281[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:12,389 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:12,389 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,391 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,392 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:12,392 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:12,392 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:12,392 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,392 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:12,393 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:12,393 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:12,393 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,393 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:12,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:12,395 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:12,396 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:12,396 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:12,396 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,396 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:12,397 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,397 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:12,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,397 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:12,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:12,398 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,399 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,401 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:12,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:12,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,401 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:12,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:12,402 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,402 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:12,502 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:12,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:12,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,508 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:12,508 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:12,508 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:12,508 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:12,508 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,508 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,510 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:12,510 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:12,511 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:12,511 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:12,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,512 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,512 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:12,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:12,512 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:12,512 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:12,512 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:12,925 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090773884e71f38247d3b611a41e0e01f153 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090773884e71f38247d3b611a41e0e01f153 2023-11-01 09:55:13,331 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/f40ac61bdf564f8cb33a2da6df6fc841 2023-11-01 09:55:13,335 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/f40ac61bdf564f8cb33a2da6df6fc841 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f40ac61bdf564f8cb33a2da6df6fc841 2023-11-01 09:55:13,340 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f40ac61bdf564f8cb33a2da6df6fc841, entries=1, sequenceid=37, filesize=5.0 K 2023-11-01 09:55:13,341 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 829ms, sequenceid=37, compaction requested=true 2023-11-01 09:55:13,341 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:13,341 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:13,341 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:13,341 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:13,341 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,341 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:13,341 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:13,342 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,342 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,343 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:13,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:13,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de66c22[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:13,344 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:13,344 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,345 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:13,345 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,345 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:13,345 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:13,347 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,347 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:13,347 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:13,347 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:13,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:13,349 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:13,349 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:13,349 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:13,349 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,349 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:13,351 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,351 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,351 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:13,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:13,352 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,353 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:13,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:13,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:13,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:13,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-01 09:55:13,355 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:13,355 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:13,356 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,356 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:13,356 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,356 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:13,456 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:13,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:13,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:13,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:13,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,461 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:13,461 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:13,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-01 09:55:13,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-01 09:55:13,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,462 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,463 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,463 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:13,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:13,463 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:13,463 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,464 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,464 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-01 09:55:13,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:13,464 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-01 09:55:13,464 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:13,464 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-01 09:55:13,464 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:55:13,464 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:13,465 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:13,465 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. started... 2023-11-01 09:55:13,465 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a0560c30c274df40af64b053783ad7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:55:13,876 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e80cd0122dc34eddba3430b9b3155ea0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e80cd0122dc34eddba3430b9b3155ea0 2023-11-01 09:55:14,281 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/30f654a4b6a44403ac22e80fddb21ace 2023-11-01 09:55:14,286 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/30f654a4b6a44403ac22e80fddb21ace as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/30f654a4b6a44403ac22e80fddb21ace 2023-11-01 09:55:14,290 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/30f654a4b6a44403ac22e80fddb21ace, entries=1, sequenceid=41, filesize=5.0 K 2023-11-01 09:55:14,290 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a0560c30c274df40af64b053783ad7e in 825ms, sequenceid=41, compaction requested=true 2023-11-01 09:55:14,290 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:14,291 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:14,291 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:55:14,291 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:55:14,291 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,291 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-01 09:55:14,291 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-01 09:55:14,292 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,292 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:14,292 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,292 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:14,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-01 09:55:14,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1546ac2[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:14,294 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-01 09:55:14,294 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,296 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,296 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-01 09:55:14,296 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-01 09:55:14,296 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:14,296 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,296 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:14,298 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-01 09:55:14,298 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:14,298 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,298 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-01 09:55:14,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:14,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:14,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:14,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:14,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-01 09:55:14,299 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-01 09:55:14,300 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:14,300 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:14,300 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,300 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:14,301 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,301 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:14,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:14,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,301 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:14,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:14,301 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:14,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:14,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:14,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,302 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:14,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,304 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,304 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:14,304 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:14,304 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:14,304 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-01 09:55:14,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:14,304 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:14,305 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:14,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:14,305 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,305 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,305 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,305 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:14,305 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:14,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:14,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:14,405 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:14,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:14,407 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:14,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:14,409 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:14,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:14,409 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833114409 2023-11-01 09:55:14,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:55:14,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-01 09:55:14,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:14,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x146eb5b9 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:14,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5826b23b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:14,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,250 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ea77ad2457eb4728ba086860ad91bd1f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ea77ad2457eb4728ba086860ad91bd1f 2023-11-01 09:55:15,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:15,264 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:15,265 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:15,272 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:55:15,273 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:55:15,284 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817e02a60d8740c7abe58f20a9834a0a first=Optional[r3] last=Optional[r6] 2023-11-01 09:55:15,284 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817e02a60d8740c7abe58f20a9834a0a}] 2023-11-01 09:55:15,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817e02a60d8740c7abe58f20a9834a0a for inclusion in 4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:15,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-01 09:55:15,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:55:15,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:15,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/817e02a60d8740c7abe58f20a9834a0a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5l8ucd0j8icfler2gm3o5esegjlv8c9nqddni6o6vftlnqcbsctq424clenan4kc/family1/817e02a60d8740c7abe58f20a9834a0a 2023-11-01 09:55:15,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5l8ucd0j8icfler2gm3o5esegjlv8c9nqddni6o6vftlnqcbsctq424clenan4kc/family1/817e02a60d8740c7abe58f20a9834a0a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_ 2023-11-01 09:55:15,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5l8ucd0j8icfler2gm3o5esegjlv8c9nqddni6o6vftlnqcbsctq424clenan4kc/family1/817e02a60d8740c7abe58f20a9834a0a into 4a0560c30c274df40af64b053783ad7e/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_ - updating store file list. 2023-11-01 09:55:15,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_ into 4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:15,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5l8ucd0j8icfler2gm3o5esegjlv8c9nqddni6o6vftlnqcbsctq424clenan4kc/family1/817e02a60d8740c7abe58f20a9834a0a into 4a0560c30c274df40af64b053783ad7e/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_) 2023-11-01 09:55:15,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__5l8ucd0j8icfler2gm3o5esegjlv8c9nqddni6o6vftlnqcbsctq424clenan4kc/family1/817e02a60d8740c7abe58f20a9834a0a 2023-11-01 09:55:15,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:55:15,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:55:15,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 4a0560c30c274df40af64b053783ad7e/family1 is initiating minor compaction 2023-11-01 09:55:15,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2cb3306c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:15,303 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a0560c30c274df40af64b053783ad7e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:15,303 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/969d589b6ad740adbea44312907f18ba, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f8ea5fe2d80648a9835638205c6b23b8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e96d60c7a43240438ee0bdfdc57842fd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/af467fbc561842deae55b32465008a84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/66cf232e9aab4a8c8bdad2c34231509b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/061bb76faeac4a338545b76acbdd697b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/ef5fed720c8d4aa6b4364b7212e13cdb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f40ac61bdf564f8cb33a2da6df6fc841, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/30f654a4b6a44403ac22e80fddb21ace, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp, totalSize=50.3 K 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 969d589b6ad740adbea44312907f18ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting f8ea5fe2d80648a9835638205c6b23b8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting e96d60c7a43240438ee0bdfdc57842fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting af467fbc561842deae55b32465008a84, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 66cf232e9aab4a8c8bdad2c34231509b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 061bb76faeac4a338545b76acbdd697b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting ef5fed720c8d4aa6b4364b7212e13cdb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting f40ac61bdf564f8cb33a2da6df6fc841, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 30f654a4b6a44403ac22e80fddb21ace, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:55:15,303 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 63d199dfa3724c21909218e59ec198e6_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:55:15,304 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:15,305 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:15,307 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122815e0f007344346f7af991ae26da8041d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122815e0f007344346f7af991ae26da8041d 2023-11-01 09:55:15,308 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318d70f81c20844e0bbab61fff35860b7b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318d70f81c20844e0bbab61fff35860b7b 2023-11-01 09:55:15,310 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c051a2bf17f941dfa5e6a1468c282616 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c051a2bf17f941dfa5e6a1468c282616 2023-11-01 09:55:15,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038521bcff0f0f4bf5b56f9d5f4db26680 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038521bcff0f0f4bf5b56f9d5f4db26680 2023-11-01 09:55:15,311 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-01 09:55:15,311 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:15,341 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a0560c30c274df40af64b053783ad7e#family1#compaction#73 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:16,155 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/4c39f798a8e44c8d95399a4d3e5d2e45 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/4c39f798a8e44c8d95399a4d3e5d2e45 2023-11-01 09:55:16,160 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4a0560c30c274df40af64b053783ad7e/family1 of 4a0560c30c274df40af64b053783ad7e into 4c39f798a8e44c8d95399a4d3e5d2e45(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:55:16,160 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:16,160 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698832515302; duration=0sec 2023-11-01 09:55:16,160 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:16,162 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054214bf27aae741b7a765666053bf3449 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054214bf27aae741b7a765666053bf3449 2023-11-01 09:55:16,163 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:16,187 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca first=Optional[r00] last=Optional[r2] 2023-11-01 09:55:16,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca}] 2023-11-01 09:55:16,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca for inclusion in 4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:16,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-01 09:55:16,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:55:16,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:16,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf5omklfr26kjo7kmff4ut8v7egh4ln5u0m3p29sgjuf56qbjgi0j3kehg2o1c1f/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca 2023-11-01 09:55:16,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf5omklfr26kjo7kmff4ut8v7egh4ln5u0m3p29sgjuf56qbjgi0j3kehg2o1c1f/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_ 2023-11-01 09:55:16,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf5omklfr26kjo7kmff4ut8v7egh4ln5u0m3p29sgjuf56qbjgi0j3kehg2o1c1f/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca into 4a0560c30c274df40af64b053783ad7e/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_ - updating store file list. 2023-11-01 09:55:16,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_ into 4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:16,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf5omklfr26kjo7kmff4ut8v7egh4ln5u0m3p29sgjuf56qbjgi0j3kehg2o1c1f/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca into 4a0560c30c274df40af64b053783ad7e/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_) 2023-11-01 09:55:16,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__vf5omklfr26kjo7kmff4ut8v7egh4ln5u0m3p29sgjuf56qbjgi0j3kehg2o1c1f/family1/8f9ac02f0a0b4aa48ec23da6e9b069ca 2023-11-01 09:55:16,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:55:16,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:55:16,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 4a0560c30c274df40af64b053783ad7e/family1 is initiating minor compaction (all files) 2023-11-01 09:55:16,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@741911ab; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:16,202 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a0560c30c274df40af64b053783ad7e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:16,202 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e0b90645a1414ced825fea9ff1481596, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/4c39f798a8e44c8d95399a4d3e5d2e45, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp, totalSize=388.1 K 2023-11-01 09:55:16,202 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting e0b90645a1414ced825fea9ff1481596, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:55:16,203 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 4c39f798a8e44c8d95399a4d3e5d2e45, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:55:16,203 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 2d5b517b54a3464591450537a095d9c0_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878856338 2023-11-01 09:55:16,203 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:16,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:16,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306e59d7a7e4c34af28261780e0e9634ef to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306e59d7a7e4c34af28261780e0e9634ef 2023-11-01 09:55:16,208 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d2b141748f724023bbacab3e6a5a6860 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d2b141748f724023bbacab3e6a5a6860 2023-11-01 09:55:16,209 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d2f3a38ba56d41c4921f0c23f74c9d07 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d2f3a38ba56d41c4921f0c23f74c9d07 2023-11-01 09:55:16,210 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-01 09:55:16,210 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-01 09:55:16,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:16,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:16,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:16,212 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:16,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8050 sec 2023-11-01 09:55:16,224 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a0560c30c274df40af64b053783ad7e#family1#compaction#74 average throughput is 13.82 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:16,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/969d589b6ad740adbea44312907f18ba, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f8ea5fe2d80648a9835638205c6b23b8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e96d60c7a43240438ee0bdfdc57842fd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/af467fbc561842deae55b32465008a84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/66cf232e9aab4a8c8bdad2c34231509b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/061bb76faeac4a338545b76acbdd697b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/ef5fed720c8d4aa6b4364b7212e13cdb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f40ac61bdf564f8cb33a2da6df6fc841, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/30f654a4b6a44403ac22e80fddb21ace, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_] to archive 2023-11-01 09:55:16,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:16,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/969d589b6ad740adbea44312907f18ba to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/969d589b6ad740adbea44312907f18ba 2023-11-01 09:55:16,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f8ea5fe2d80648a9835638205c6b23b8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f8ea5fe2d80648a9835638205c6b23b8 2023-11-01 09:55:16,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e96d60c7a43240438ee0bdfdc57842fd to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e96d60c7a43240438ee0bdfdc57842fd 2023-11-01 09:55:16,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/af467fbc561842deae55b32465008a84 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/af467fbc561842deae55b32465008a84 2023-11-01 09:55:16,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/66cf232e9aab4a8c8bdad2c34231509b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/66cf232e9aab4a8c8bdad2c34231509b 2023-11-01 09:55:16,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/061bb76faeac4a338545b76acbdd697b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/061bb76faeac4a338545b76acbdd697b 2023-11-01 09:55:16,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/ef5fed720c8d4aa6b4364b7212e13cdb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/ef5fed720c8d4aa6b4364b7212e13cdb 2023-11-01 09:55:16,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f40ac61bdf564f8cb33a2da6df6fc841 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/f40ac61bdf564f8cb33a2da6df6fc841 2023-11-01 09:55:16,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/30f654a4b6a44403ac22e80fddb21ace to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/30f654a4b6a44403ac22e80fddb21ace 2023-11-01 09:55:16,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/63d199dfa3724c21909218e59ec198e6_SeqId_44_ 2023-11-01 09:55:16,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-01 09:55:16,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:16,696 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-01 09:55:16,697 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-01 09:55:16,697 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-01 09:55:16,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-01 09:55:16,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE}] 2023-11-01 09:55:16,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE 2023-11-01 09:55:16,702 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:16,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832516702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832516702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832516702"}]},"ts":"1698832516702"} 2023-11-01 09:55:16,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:16,855 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:16,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:16,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a0560c30c274df40af64b053783ad7e, disabling compactions & flushes 2023-11-01 09:55:16,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,440 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/.tmp/family1/2d85a130b2664ab099bdaf86e499071a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d85a130b2664ab099bdaf86e499071a 2023-11-01 09:55:17,444 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4a0560c30c274df40af64b053783ad7e/family1 of 4a0560c30c274df40af64b053783ad7e into 2d85a130b2664ab099bdaf86e499071a(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:17,444 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:17,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. after waiting 0 ms 2023-11-01 09:55:17,444 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698832516201; duration=1sec 2023-11-01 09:55:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,445 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:17,447 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e0b90645a1414ced825fea9ff1481596, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/4c39f798a8e44c8d95399a4d3e5d2e45, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_] to archive 2023-11-01 09:55:17,448 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:17,450 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e0b90645a1414ced825fea9ff1481596 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/e0b90645a1414ced825fea9ff1481596 2023-11-01 09:55:17,451 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/4c39f798a8e44c8d95399a4d3e5d2e45 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/4c39f798a8e44c8d95399a4d3e5d2e45 2023-11-01 09:55:17,452 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d5b517b54a3464591450537a095d9c0_SeqId_47_ 2023-11-01 09:55:17,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-01 09:55:17,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:17,456 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 4a0560c30c274df40af64b053783ad7e to self. 2023-11-01 09:55:17,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=CLOSED 2023-11-01 09:55:17,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832517458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832517458"}]},"ts":"1698832517458"} 2023-11-01 09:55:17,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-01 09:55:17,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817 in 755 msec 2023-11-01 09:55:17,460 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=true 2023-11-01 09:55:17,611 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:17,611 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832517611"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832517611"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832517611"}]},"ts":"1698832517611"} 2023-11-01 09:55:17,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:17,763 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:17,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a0560c30c274df40af64b053783ad7e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:55:17,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:17,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,768 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,769 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:17,769 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:17,769 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a0560c30c274df40af64b053783ad7e columnFamilyName family1 2023-11-01 09:55:17,773 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d85a130b2664ab099bdaf86e499071a 2023-11-01 09:55:17,773 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(310): Store=4a0560c30c274df40af64b053783ad7e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:17,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:17,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a0560c30c274df40af64b053783ad7e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70729324, jitterRate=0.053949058055877686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:55:17,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:17,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., pid=63, masterSystemTime=1698832517763 2023-11-01 09:55:17,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:17,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:17,780 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832517780"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832517780"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832517780"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832517780"}]},"ts":"1698832517780"} 2023-11-01 09:55:17,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-01 09:55:17,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817 in 169 msec 2023-11-01 09:55:17,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-01 09:55:17,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE in 1.0820 sec 2023-11-01 09:55:17,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-01 09:55:17,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0850 sec 2023-11-01 09:55:17,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5000 sec 2023-11-01 09:55:17,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-01 09:55:17,789 INFO [Listener at localhost/37085] compactions.TestMobCompactor(278): alter status finished 2023-11-01 09:55:17,790 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:17,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:17,791 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:17,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:17,792 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833117792 2023-11-01 09:55:17,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:55:17,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-01 09:55:17,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:17,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x7d1e6291 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:17,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50067806, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:17,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:17,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:17,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:17,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:17,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:18,621 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280a71d4990615469584c0e7023a70988b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280a71d4990615469584c0e7023a70988b 2023-11-01 09:55:18,622 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:18,635 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:18,635 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:18,641 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:55:18,642 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:55:18,649 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a8ab2906f1ed4e95a8830a20f85ce097 first=Optional[r05] last=Optional[r8] 2023-11-01 09:55:18,650 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=51 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a8ab2906f1ed4e95a8830a20f85ce097}] 2023-11-01 09:55:18,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a8ab2906f1ed4e95a8830a20f85ce097 for inclusion in 4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:18,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-01 09:55:18,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:55:18,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:18,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a8ab2906f1ed4e95a8830a20f85ce097 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fd04t2ui5qekqka0655bftqo2ecmsesmssjcsbar1idfn2on82ingb6956htl5lt/family1/a8ab2906f1ed4e95a8830a20f85ce097 2023-11-01 09:55:18,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fd04t2ui5qekqka0655bftqo2ecmsesmssjcsbar1idfn2on82ingb6956htl5lt/family1/a8ab2906f1ed4e95a8830a20f85ce097 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2a042ba8ccc24f638c49e2eca9c5805b_SeqId_53_ 2023-11-01 09:55:18,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fd04t2ui5qekqka0655bftqo2ecmsesmssjcsbar1idfn2on82ingb6956htl5lt/family1/a8ab2906f1ed4e95a8830a20f85ce097 into 4a0560c30c274df40af64b053783ad7e/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2a042ba8ccc24f638c49e2eca9c5805b_SeqId_53_ - updating store file list. 2023-11-01 09:55:18,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2a042ba8ccc24f638c49e2eca9c5805b_SeqId_53_ into 4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:18,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fd04t2ui5qekqka0655bftqo2ecmsesmssjcsbar1idfn2on82ingb6956htl5lt/family1/a8ab2906f1ed4e95a8830a20f85ce097 into 4a0560c30c274df40af64b053783ad7e/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2a042ba8ccc24f638c49e2eca9c5805b_SeqId_53_) 2023-11-01 09:55:18,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fd04t2ui5qekqka0655bftqo2ecmsesmssjcsbar1idfn2on82ingb6956htl5lt/family1/a8ab2906f1ed4e95a8830a20f85ce097 2023-11-01 09:55:18,664 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:18,664 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:18,666 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e80cd0122dc34eddba3430b9b3155ea0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e80cd0122dc34eddba3430b9b3155ea0 2023-11-01 09:55:18,667 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128859275e7ef254d87870e38321ad0ceb5 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128859275e7ef254d87870e38321ad0ceb5 2023-11-01 09:55:18,667 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-01 09:55:18,667 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-01 09:55:18,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:18,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:18,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:18,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:18,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:18,668 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:18,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 878 msec 2023-11-01 09:55:18,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-01 09:55:18,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:19,124 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-01 09:55:19,124 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-01 09:55:19,125 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-01 09:55:19,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-01 09:55:19,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE}] 2023-11-01 09:55:19,129 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE 2023-11-01 09:55:19,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:19,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832519130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832519130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832519130"}]},"ts":"1698832519130"} 2023-11-01 09:55:19,131 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41153] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,40233,1698832432817, table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-01 09:55:19,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:19,282 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:19,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a0560c30c274df40af64b053783ad7e, disabling compactions & flushes 2023-11-01 09:55:19,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. after waiting 0 ms 2023-11-01 09:55:19,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-01 09:55:19,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:19,290 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 4a0560c30c274df40af64b053783ad7e to self. 2023-11-01 09:55:19,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,292 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=CLOSED 2023-11-01 09:55:19,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832519292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832519292"}]},"ts":"1698832519292"} 2023-11-01 09:55:19,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-01 09:55:19,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817 in 162 msec 2023-11-01 09:55:19,294 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=true 2023-11-01 09:55:19,445 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:19,445 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832519445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832519445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832519445"}]},"ts":"1698832519445"} 2023-11-01 09:55:19,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:19,598 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:19,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a0560c30c274df40af64b053783ad7e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:55:19,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:19,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,601 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,602 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:19,602 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1 2023-11-01 09:55:19,603 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a0560c30c274df40af64b053783ad7e columnFamilyName family1 2023-11-01 09:55:19,607 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2a042ba8ccc24f638c49e2eca9c5805b_SeqId_53_ 2023-11-01 09:55:19,610 DEBUG [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/family1/2d85a130b2664ab099bdaf86e499071a 2023-11-01 09:55:19,610 INFO [StoreOpener-4a0560c30c274df40af64b053783ad7e-1] regionserver.HStore(310): Store=4a0560c30c274df40af64b053783ad7e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:19,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:55:19,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a0560c30c274df40af64b053783ad7e; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61958048, jitterRate=-0.07675313949584961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:55:19,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:55:19,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e., pid=69, masterSystemTime=1698832519597 2023-11-01 09:55:19,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:55:19,617 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4a0560c30c274df40af64b053783ad7e, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:19,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698832519617"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832519617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832519617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832519617"}]},"ts":"1698832519617"} 2023-11-01 09:55:19,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-01 09:55:19,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 4a0560c30c274df40af64b053783ad7e, server=jenkins-hbase4.apache.org,40233,1698832432817 in 172 msec 2023-11-01 09:55:19,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-01 09:55:19,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4a0560c30c274df40af64b053783ad7e, REOPEN/MOVE in 490 msec 2023-11-01 09:55:19,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-01 09:55:19,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 495 msec 2023-11-01 09:55:19,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 907 msec 2023-11-01 09:55:19,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-01 09:55:19,624 INFO [Listener at localhost/37085] compactions.TestMobCompactor(278): alter status finished 2023-11-01 09:55:19,625 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-01 09:55:19,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:19,627 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:19,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:19,627 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833119627 2023-11-01 09:55:19,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:55:19,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-01 09:55:19,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:19,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x2b7282ed to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:19,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b694e86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-01 09:55:19,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-01 09:55:19,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:19,635 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-01 09:55:19,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-11-01 09:55:19,680 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=252 (was 244) - Thread LEAK? -, OpenFileDescriptor=643 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 189) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=10564 (was 10579) 2023-11-01 09:55:19,691 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=252, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=169, AvailableMemoryMB=10563 2023-11-01 09:55:19,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-01 09:55:19,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:19,696 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:55:19,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-01 09:55:19,696 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:55:19,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-01 09:55:19,697 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:19,698 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 empty. 2023-11-01 09:55:19,698 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:19,698 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-01 09:55:19,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-01 09:55:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-01 09:55:20,111 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-01 09:55:20,113 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 28b85ab73ebd72b62bf4281cce496fa9, NAME => 'testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:20,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-01 09:55:20,518 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:20,519 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 28b85ab73ebd72b62bf4281cce496fa9, disabling compactions & flushes 2023-11-01 09:55:20,519 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,519 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,519 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. after waiting 0 ms 2023-11-01 09:55:20,519 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,519 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,519 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:20,521 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:55:20,522 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698832520522"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832520522"}]},"ts":"1698832520522"} 2023-11-01 09:55:20,523 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:55:20,523 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:55:20,524 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832520524"}]},"ts":"1698832520524"} 2023-11-01 09:55:20,525 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-01 09:55:20,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, ASSIGN}] 2023-11-01 09:55:20,530 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, ASSIGN 2023-11-01 09:55:20,530 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:20,681 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=28b85ab73ebd72b62bf4281cce496fa9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:20,681 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698832520681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832520681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832520681"}]},"ts":"1698832520681"} 2023-11-01 09:55:20,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 28b85ab73ebd72b62bf4281cce496fa9, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:20,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-01 09:55:20,834 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:20,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28b85ab73ebd72b62bf4281cce496fa9, NAME => 'testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:55:20,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-01 09:55:20,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-01 09:55:20,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:20,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,840 INFO [StoreOpener-28b85ab73ebd72b62bf4281cce496fa9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,841 DEBUG [StoreOpener-28b85ab73ebd72b62bf4281cce496fa9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1 2023-11-01 09:55:20,841 DEBUG [StoreOpener-28b85ab73ebd72b62bf4281cce496fa9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1 2023-11-01 09:55:20,841 INFO [StoreOpener-28b85ab73ebd72b62bf4281cce496fa9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28b85ab73ebd72b62bf4281cce496fa9 columnFamilyName f1 2023-11-01 09:55:20,842 INFO [StoreOpener-28b85ab73ebd72b62bf4281cce496fa9-1] regionserver.HStore(310): Store=28b85ab73ebd72b62bf4281cce496fa9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:20,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:20,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:20,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28b85ab73ebd72b62bf4281cce496fa9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61388696, jitterRate=-0.08523714542388916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:55:20,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:20,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9., pid=73, masterSystemTime=1698832520834 2023-11-01 09:55:20,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:20,849 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=28b85ab73ebd72b62bf4281cce496fa9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:20,849 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698832520849"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832520849"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832520849"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832520849"}]},"ts":"1698832520849"} 2023-11-01 09:55:20,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-01 09:55:20,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 28b85ab73ebd72b62bf4281cce496fa9, server=jenkins-hbase4.apache.org,40233,1698832432817 in 167 msec 2023-11-01 09:55:20,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-01 09:55:20,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, ASSIGN in 323 msec 2023-11-01 09:55:20,853 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:55:20,853 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832520853"}]},"ts":"1698832520853"} 2023-11-01 09:55:20,854 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-01 09:55:20,856 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:55:20,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1620 sec 2023-11-01 09:55:21,736 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-01 09:55:21,736 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-01 09:55:21,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-01 09:55:21,801 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-01 09:55:21,802 DEBUG [Listener at localhost/37085] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-01 09:55:21,803 INFO [Listener at localhost/37085] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-01 09:55:21,806 INFO [Listener at localhost/37085] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-01 09:55:21,807 INFO [Listener at localhost/37085] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-01 09:55:21,807 INFO [Listener at localhost/37085] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-01 09:55:21,810 INFO [Listener at localhost/37085] regionserver.HRegion(2745): Flushing 28b85ab73ebd72b62bf4281cce496fa9 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-01 09:55:22,222 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110176a12c045ae048768e627dd86eabe925 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023110176a12c045ae048768e627dd86eabe925 2023-11-01 09:55:22,628 INFO [Listener at localhost/37085] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/.tmp/f1/2491781673224033a2dca2e86a5c053f 2023-11-01 09:55:22,633 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/.tmp/f1/2491781673224033a2dca2e86a5c053f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f 2023-11-01 09:55:22,636 INFO [Listener at localhost/37085] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f, entries=1, sequenceid=5, filesize=4.9 K 2023-11-01 09:55:22,637 INFO [Listener at localhost/37085] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 28b85ab73ebd72b62bf4281cce496fa9 in 827ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:22,637 DEBUG [Listener at localhost/37085] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-01 09:55:22,638 DEBUG [Listener at localhost/37085] regionserver.HRegion(2446): Flush status journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:22,640 INFO [Listener at localhost/37085] regionserver.HRegion(2745): Flushing 28b85ab73ebd72b62bf4281cce496fa9 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-01 09:55:22,986 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:55:23,051 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110109b2114f697a4f0f8ddfbb7f5ce022e4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023110109b2114f697a4f0f8ddfbb7f5ce022e4 2023-11-01 09:55:23,456 INFO [Listener at localhost/37085] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/.tmp/f1/276a79cfe678459aaa23d767bcc7f2cc 2023-11-01 09:55:23,460 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/.tmp/f1/276a79cfe678459aaa23d767bcc7f2cc as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc 2023-11-01 09:55:23,464 INFO [Listener at localhost/37085] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc, entries=1, sequenceid=9, filesize=4.9 K 2023-11-01 09:55:23,464 INFO [Listener at localhost/37085] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 28b85ab73ebd72b62bf4281cce496fa9 in 824ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:23,465 DEBUG [Listener at localhost/37085] regionserver.HRegion(2446): Flush status journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:23,466 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-01 09:55:23,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-01 09:55:23,468 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-01 09:55:23,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:23,468 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833123468 2023-11-01 09:55:23,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-01 09:55:23,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-01 09:55:23,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-01 09:55:23,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x2bba3b1c to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:23,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ab65d93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:23,474 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231101 for table='testGetAfterCompaction' and column='f1' 2023-11-01 09:55:23,517 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,517 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,568 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,568 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,618 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,618 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,669 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,669 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,720 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,720 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,770 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,770 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,821 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,821 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,871 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,872 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,922 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,922 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,973 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:23,973 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,023 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,023 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,074 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,074 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,125 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,125 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,175 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,176 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,226 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,226 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,277 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,277 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,296 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311018879eb4a13324b72a9590c1a0f98eb3b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311018879eb4a13324b72a9590c1a0f98eb3b 2023-11-01 09:55:24,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testGetAfterCompaction' column='f1' 2023-11-01 09:55:24,309 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:24,310 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:24,316 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:55:24,317 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:55:24,325 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/f1/9d99ee43a99b4e8e98fa59a840eff136 first=Optional[r1] last=Optional[r2] 2023-11-01 09:55:24,326 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{f1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/f1/9d99ee43a99b4e8e98fa59a840eff136}] 2023-11-01 09:55:24,327 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,328 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/f1/9d99ee43a99b4e8e98fa59a840eff136 for inclusion in 28b85ab73ebd72b62bf4281cce496fa9/f1 2023-11-01 09:55:24,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-01 09:55:24,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:55:24,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:24,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/f1/9d99ee43a99b4e8e98fa59a840eff136 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testGetAfterCompaction__8ro0750h5bh2p7lh36bf1h79l5pdref4u0du5bph37vjfejetlgkloubrfp183al/f1/9d99ee43a99b4e8e98fa59a840eff136 2023-11-01 09:55:24,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testGetAfterCompaction__8ro0750h5bh2p7lh36bf1h79l5pdref4u0du5bph37vjfejetlgkloubrfp183al/f1/9d99ee43a99b4e8e98fa59a840eff136 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_ 2023-11-01 09:55:24,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testGetAfterCompaction__8ro0750h5bh2p7lh36bf1h79l5pdref4u0du5bph37vjfejetlgkloubrfp183al/f1/9d99ee43a99b4e8e98fa59a840eff136 into 28b85ab73ebd72b62bf4281cce496fa9/f1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_ - updating store file list. 2023-11-01 09:55:24,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_ into 28b85ab73ebd72b62bf4281cce496fa9/f1 2023-11-01 09:55:24,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testGetAfterCompaction__8ro0750h5bh2p7lh36bf1h79l5pdref4u0du5bph37vjfejetlgkloubrfp183al/f1/9d99ee43a99b4e8e98fa59a840eff136 into 28b85ab73ebd72b62bf4281cce496fa9/f1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_) 2023-11-01 09:55:24,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testGetAfterCompaction__8ro0750h5bh2p7lh36bf1h79l5pdref4u0du5bph37vjfejetlgkloubrfp183al/f1/9d99ee43a99b4e8e98fa59a840eff136 2023-11-01 09:55:24,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(1912): 28b85ab73ebd72b62bf4281cce496fa9/f1 is initiating minor compaction 2023-11-01 09:55:24,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@25a75828; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:24,338 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 28b85ab73ebd72b62bf4281cce496fa9/f1 in testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:24,338 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/.tmp, totalSize=10.0 K 2023-11-01 09:55:24,338 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 276a79cfe678459aaa23d767bcc7f2cc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:55:24,338 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 26f90d30942a4476a5f996149954bfc3_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:55:24,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testGetAfterCompaction' column='f1' 2023-11-01 09:55:24,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:24,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023110109b2114f697a4f0f8ddfbb7f5ce022e4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023110109b2114f697a4f0f8ddfbb7f5ce022e4 2023-11-01 09:55:24,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023110176a12c045ae048768e627dd86eabe925 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023110176a12c045ae048768e627dd86eabe925 2023-11-01 09:55:24,344 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-01 09:55:24,344 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231101' 2023-11-01 09:55:24,344 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231101 for table='testGetAfterCompaction' and column='f1' 2023-11-01 09:55:24,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-01 09:55:24,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:55:24,345 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-01 09:55:24,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 878 msec 2023-11-01 09:55:24,347 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 28b85ab73ebd72b62bf4281cce496fa9#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:24,378 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,379 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,379 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,382 DEBUG [Listener at localhost/37085] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-01 09:55:24,385 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-01 09:55:24,385 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40233] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:24,385 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-01 09:55:24,385 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-01 09:55:24,385 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40233] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-01 09:55:24,385 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40233] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. because compaction request was cancelled 2023-11-01 09:55:24,437 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,437 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,437 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,487 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,487 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,487 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,538 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,538 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,538 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,589 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,589 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,589 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,639 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,639 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,639 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,690 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,690 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,690 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,741 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,741 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,741 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,792 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,792 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,792 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,842 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,843 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,843 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,893 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,893 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,893 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,944 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,944 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,944 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,994 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:24,995 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:24,995 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,045 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,045 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:25,045 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,096 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,096 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:25,096 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,147 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,147 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:25,147 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,160 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/.tmp/f1/68b6ac10abca417d933ea8d8bc7a1d62 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/68b6ac10abca417d933ea8d8bc7a1d62 2023-11-01 09:55:25,165 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 28b85ab73ebd72b62bf4281cce496fa9/f1 of 28b85ab73ebd72b62bf4281cce496fa9 into 68b6ac10abca417d933ea8d8bc7a1d62(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:55:25,165 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:25,165 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698832524338; duration=0sec 2023-11-01 09:55:25,165 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:25,197 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,198 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:25,198 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,198 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/68b6ac10abca417d933ea8d8bc7a1d62; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698832525156; access_time=1698832524343; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,248 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,248 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698832524292; access_time=1698832523484; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-01 09:55:25,248 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832523455; access_time=1698832522641; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,248 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/68b6ac10abca417d933ea8d8bc7a1d62; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698832525156; access_time=1698832524343; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_] to archive 2023-11-01 09:55:25,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:25,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/276a79cfe678459aaa23d767bcc7f2cc 2023-11-01 09:55:25,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/26f90d30942a4476a5f996149954bfc3_SeqId_12_ 2023-11-01 09:55:25,299 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698832522627; access_time=1698832521813; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,299 INFO [Listener at localhost/37085] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/68b6ac10abca417d933ea8d8bc7a1d62; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698832525156; access_time=1698832524343; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-01 09:55:25,413 INFO [Listener at localhost/37085] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-01 09:55:25,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-01 09:55:25,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832525426"}]},"ts":"1698832525426"} 2023-11-01 09:55:25,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-01 09:55:25,427 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-01 09:55:25,428 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-01 09:55:25,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, UNASSIGN}] 2023-11-01 09:55:25,431 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, UNASSIGN 2023-11-01 09:55:25,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=28b85ab73ebd72b62bf4281cce496fa9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:25,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698832525431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832525431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832525431"}]},"ts":"1698832525431"} 2023-11-01 09:55:25,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 28b85ab73ebd72b62bf4281cce496fa9, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:25,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-01 09:55:25,583 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:25,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:25,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28b85ab73ebd72b62bf4281cce496fa9, disabling compactions & flushes 2023-11-01 09:55:25,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:25,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:25,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. after waiting 0 ms 2023-11-01 09:55:25,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:25,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-01 09:55:25,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-01 09:55:25,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9. 2023-11-01 09:55:25,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28b85ab73ebd72b62bf4281cce496fa9: 2023-11-01 09:55:25,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:25,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=28b85ab73ebd72b62bf4281cce496fa9, regionState=CLOSED 2023-11-01 09:55:25,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698832525590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832525590"}]},"ts":"1698832525590"} 2023-11-01 09:55:25,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-01 09:55:25,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 28b85ab73ebd72b62bf4281cce496fa9, server=jenkins-hbase4.apache.org,40233,1698832432817 in 160 msec 2023-11-01 09:55:25,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-01 09:55:25,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=28b85ab73ebd72b62bf4281cce496fa9, UNASSIGN in 163 msec 2023-11-01 09:55:25,594 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832525594"}]},"ts":"1698832525594"} 2023-11-01 09:55:25,595 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-01 09:55:25,596 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-01 09:55:25,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 178 msec 2023-11-01 09:55:25,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-01 09:55:25,729 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-01 09:55:25,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-01 09:55:25,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,740 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,741 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-01 09:55:25,744 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:25,746 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1, FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/recovered.edits] 2023-11-01 09:55:25,750 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/2491781673224033a2dca2e86a5c053f 2023-11-01 09:55:25,751 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/68b6ac10abca417d933ea8d8bc7a1d62 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/f1/68b6ac10abca417d933ea8d8bc7a1d62 2023-11-01 09:55:25,754 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/recovered.edits/15.seqid to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9/recovered.edits/15.seqid 2023-11-01 09:55:25,755 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testGetAfterCompaction/28b85ab73ebd72b62bf4281cce496fa9 2023-11-01 09:55:25,755 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-01 09:55:25,756 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-01 09:55:25,756 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-01 09:55:25,759 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311018879eb4a13324b72a9590c1a0f98eb3b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311018879eb4a13324b72a9590c1a0f98eb3b 2023-11-01 09:55:25,760 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-01 09:55:25,762 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,784 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-01 09:55:25,786 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-01 09:55:25,787 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,787 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-01 09:55:25,787 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698832525787"}]},"ts":"9223372036854775807"} 2023-11-01 09:55:25,789 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-01 09:55:25,789 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 28b85ab73ebd72b62bf4281cce496fa9, NAME => 'testGetAfterCompaction,,1698832519694.28b85ab73ebd72b62bf4281cce496fa9.', STARTKEY => '', ENDKEY => ''}] 2023-11-01 09:55:25,789 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-01 09:55:25,789 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698832525789"}]},"ts":"9223372036854775807"} 2023-11-01 09:55:25,790 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-01 09:55:25,795 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-01 09:55:25,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 61 msec 2023-11-01 09:55:25,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-01 09:55:25,843 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-01 09:55:25,856 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=255 (was 252) - Thread LEAK? -, OpenFileDescriptor=640 (was 643), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 197), ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=10557 (was 10563) 2023-11-01 09:55:25,866 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=255, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=172, AvailableMemoryMB=10557 2023-11-01 09:55:25,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-01 09:55:25,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-01 09:55:25,869 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:55:25,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-01 09:55:25,870 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:55:25,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-01 09:55:25,872 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:25,872 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:25,872 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:25,872 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 empty. 2023-11-01 09:55:25,873 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 empty. 2023-11-01 09:55:25,873 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee empty. 2023-11-01 09:55:25,873 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:25,873 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:25,873 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:25,873 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-01 09:55:25,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-01 09:55:26,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-01 09:55:26,262 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:55:26,263 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bba3b1c to 127.0.0.1:49762 2023-11-01 09:55:26,263 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,263 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:55:26,264 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d1e6291 to 127.0.0.1:49762 2023-11-01 09:55:26,264 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,264 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b7282ed to 127.0.0.1:49762 2023-11-01 09:55:26,264 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,264 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:55:26,264 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x146eb5b9 to 127.0.0.1:49762 2023-11-01 09:55:26,264 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,264 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:55:26,264 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17209172 to 127.0.0.1:49762 2023-11-01 09:55:26,264 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,265 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61f17177 to 127.0.0.1:49762 2023-11-01 09:55:26,265 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,265 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:55:26,265 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a641a84 to 127.0.0.1:49762 2023-11-01 09:55:26,265 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:26,283 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-01 09:55:26,285 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f8f2e3d3c925badce7580bd7572b250, NAME => 'testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:26,285 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce95d44a8b3e79de7f5aab9d535373ee, NAME => 'testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:26,285 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => a1270fae216de4a507f8780689d9bb05, NAME => 'testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:26,291 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:26,291 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing ce95d44a8b3e79de7f5aab9d535373ee, disabling compactions & flushes 2023-11-01 09:55:26,291 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:26,291 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:26,291 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. after waiting 0 ms 2023-11-01 09:55:26,291 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:26,291 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:26,291 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:26,297 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:26,297 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing a1270fae216de4a507f8780689d9bb05, disabling compactions & flushes 2023-11-01 09:55:26,297 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:26,297 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:26,297 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. after waiting 0 ms 2023-11-01 09:55:26,297 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:26,297 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:26,297 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:26,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-01 09:55:26,691 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:26,691 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 6f8f2e3d3c925badce7580bd7572b250, disabling compactions & flushes 2023-11-01 09:55:26,691 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:26,691 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:26,691 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. after waiting 0 ms 2023-11-01 09:55:26,691 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:26,691 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:26,691 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:26,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:55:26,694 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832526694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832526694"}]},"ts":"1698832526694"} 2023-11-01 09:55:26,694 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832526694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832526694"}]},"ts":"1698832526694"} 2023-11-01 09:55:26,694 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832526694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832526694"}]},"ts":"1698832526694"} 2023-11-01 09:55:26,696 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-01 09:55:26,696 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:55:26,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832526696"}]},"ts":"1698832526696"} 2023-11-01 09:55:26,697 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-01 09:55:26,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN}] 2023-11-01 09:55:26,703 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN 2023-11-01 09:55:26,703 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN 2023-11-01 09:55:26,703 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN 2023-11-01 09:55:26,704 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:26,704 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:26,704 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:26,855 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6f8f2e3d3c925badce7580bd7572b250, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:26,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=a1270fae216de4a507f8780689d9bb05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:26,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=ce95d44a8b3e79de7f5aab9d535373ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:26,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832526855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832526855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832526855"}]},"ts":"1698832526855"} 2023-11-01 09:55:26,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832526855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832526855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832526855"}]},"ts":"1698832526855"} 2023-11-01 09:55:26,855 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832526855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832526855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832526855"}]},"ts":"1698832526855"} 2023-11-01 09:55:26,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:26,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:26,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:26,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-01 09:55:27,009 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:27,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:27,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1270fae216de4a507f8780689d9bb05, NAME => 'testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.', STARTKEY => '2', ENDKEY => ''} 2023-11-01 09:55:27,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:27,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,013 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,015 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:27,015 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:27,015 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1270fae216de4a507f8780689d9bb05 columnFamilyName family1 2023-11-01 09:55:27,016 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(310): Store=a1270fae216de4a507f8780689d9bb05/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:27,016 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,017 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2 2023-11-01 09:55:27,017 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2 2023-11-01 09:55:27,018 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1270fae216de4a507f8780689d9bb05 columnFamilyName family2 2023-11-01 09:55:27,019 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(310): Store=a1270fae216de4a507f8780689d9bb05/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:27,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:27,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:27,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:27,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1270fae216de4a507f8780689d9bb05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74246260, jitterRate=0.10635548830032349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:27,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:27,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05., pid=84, masterSystemTime=1698832527009 2023-11-01 09:55:27,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:27,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:27,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:27,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f8f2e3d3c925badce7580bd7572b250, NAME => 'testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.', STARTKEY => '1', ENDKEY => '2'} 2023-11-01 09:55:27,026 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=a1270fae216de4a507f8780689d9bb05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:27,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:27,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832527026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832527026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832527026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832527026"}]},"ts":"1698832527026"} 2023-11-01 09:55:27,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,028 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,029 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:27,029 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:27,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-11-01 09:55:27,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817 in 171 msec 2023-11-01 09:55:27,029 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f8f2e3d3c925badce7580bd7572b250 columnFamilyName family1 2023-11-01 09:55:27,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN in 327 msec 2023-11-01 09:55:27,030 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(310): Store=6f8f2e3d3c925badce7580bd7572b250/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:27,030 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,032 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2 2023-11-01 09:55:27,032 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2 2023-11-01 09:55:27,032 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f8f2e3d3c925badce7580bd7572b250 columnFamilyName family2 2023-11-01 09:55:27,032 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(310): Store=6f8f2e3d3c925badce7580bd7572b250/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:27,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:27,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:27,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:27,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f8f2e3d3c925badce7580bd7572b250; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72995205, jitterRate=0.0877133160829544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:27,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:27,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250., pid=83, masterSystemTime=1698832527009 2023-11-01 09:55:27,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:27,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:27,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:27,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce95d44a8b3e79de7f5aab9d535373ee, NAME => 'testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.', STARTKEY => '', ENDKEY => '1'} 2023-11-01 09:55:27,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,040 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6f8f2e3d3c925badce7580bd7572b250, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:27,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:27,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,040 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832527039"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832527039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832527039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832527039"}]},"ts":"1698832527039"} 2023-11-01 09:55:27,041 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,042 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:27,042 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:27,042 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce95d44a8b3e79de7f5aab9d535373ee columnFamilyName family1 2023-11-01 09:55:27,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=81 2023-11-01 09:55:27,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817 in 184 msec 2023-11-01 09:55:27,043 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(310): Store=ce95d44a8b3e79de7f5aab9d535373ee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:27,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN in 342 msec 2023-11-01 09:55:27,043 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,044 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2 2023-11-01 09:55:27,044 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2 2023-11-01 09:55:27,044 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce95d44a8b3e79de7f5aab9d535373ee columnFamilyName family2 2023-11-01 09:55:27,045 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(310): Store=ce95d44a8b3e79de7f5aab9d535373ee/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:27,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:27,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:27,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce95d44a8b3e79de7f5aab9d535373ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63810224, jitterRate=-0.04915356636047363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:27,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:27,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee., pid=85, masterSystemTime=1698832527009 2023-11-01 09:55:27,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:27,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:27,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=ce95d44a8b3e79de7f5aab9d535373ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:27,051 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832527051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832527051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832527051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832527051"}]},"ts":"1698832527051"} 2023-11-01 09:55:27,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-11-01 09:55:27,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817 in 194 msec 2023-11-01 09:55:27,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=80, resume processing ppid=79 2023-11-01 09:55:27,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN in 353 msec 2023-11-01 09:55:27,055 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:55:27,055 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832527055"}]},"ts":"1698832527055"} 2023-11-01 09:55:27,056 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-01 09:55:27,057 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:55:27,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1890 sec 2023-11-01 09:55:27,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-01 09:55:27,975 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-01 09:55:27,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:27,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:27,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:27,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:27,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-01 09:55:27,992 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-01 09:55:27,992 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:27,992 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-01 09:55:27,992 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-01 09:55:27,992 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:27,992 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:27,994 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:27,994 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:27,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:27,994 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:27,995 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:27,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:27,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-01 09:55:27,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-01 09:55:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-01 09:55:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-01 09:55:27,999 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:27,999 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. started... 2023-11-01 09:55:28,000 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:28,000 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f8f2e3d3c925badce7580bd7572b250 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:55:28,000 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:28,000 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. started... 2023-11-01 09:55:28,000 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. started... 2023-11-01 09:55:28,000 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:28,001 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a1270fae216de4a507f8780689d9bb05 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:55:28,001 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ce95d44a8b3e79de7f5aab9d535373ee 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:55:28,425 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba 2023-11-01 09:55:28,426 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 2023-11-01 09:55:28,431 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/8aff520de3e741289910198c4ddd903b 2023-11-01 09:55:28,434 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d 2023-11-01 09:55:28,442 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/7601c27a248446958d3a299270c4996a 2023-11-01 09:55:28,831 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/172b5f58fc4a4029b6a3e2e461d76e01 2023-11-01 09:55:28,853 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101e8e51e3b009e40799cf69cd49a2a9b7f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101e8e51e3b009e40799cf69cd49a2a9b7f 2023-11-01 09:55:28,856 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311010adc5c82ccc946e7b5dbd1072faaf0e9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311010adc5c82ccc946e7b5dbd1072faaf0e9 2023-11-01 09:55:28,860 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/55607dfd0f954410a7929868c1f853ed 2023-11-01 09:55:28,864 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/7601c27a248446958d3a299270c4996a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a 2023-11-01 09:55:28,867 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-01 09:55:28,867 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/55607dfd0f954410a7929868c1f853ed as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed 2023-11-01 09:55:28,870 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:55:28,871 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6f8f2e3d3c925badce7580bd7572b250 in 871ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:28,871 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-01 09:55:28,871 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:28,871 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:28,871 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:29,246 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101b378a8901c9f473badda5377d50e9c82 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101b378a8901c9f473badda5377d50e9c82 2023-11-01 09:55:29,259 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/6ca4e2695fea44ef896f32344bb250d2 2023-11-01 09:55:29,262 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/8aff520de3e741289910198c4ddd903b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b 2023-11-01 09:55:29,266 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b, entries=4, sequenceid=5, filesize=5.4 K 2023-11-01 09:55:29,266 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/6ca4e2695fea44ef896f32344bb250d2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2 2023-11-01 09:55:29,270 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:55:29,270 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a1270fae216de4a507f8780689d9bb05 in 1269ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:29,271 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:29,651 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/968dc0f7a48f4cab98e19e18ed3f7314 2023-11-01 09:55:29,655 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/172b5f58fc4a4029b6a3e2e461d76e01 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01 2023-11-01 09:55:29,658 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01, entries=4, sequenceid=5, filesize=5.4 K 2023-11-01 09:55:29,658 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/968dc0f7a48f4cab98e19e18ed3f7314 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314 2023-11-01 09:55:29,662 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:55:29,663 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ce95d44a8b3e79de7f5aab9d535373ee in 1662ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:29,663 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:29,663 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-01 09:55:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-01 09:55:29,665 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,665 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:29,665 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,665 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:29,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-01 09:55:29,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70756cd3[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:29,666 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-01 09:55:29,666 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,667 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-01 09:55:29,667 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-01 09:55:29,668 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:29,668 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,668 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:29,669 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,669 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-01 09:55:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:29,669 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:29,669 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-01 09:55:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:29,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-01 09:55:29,671 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-01 09:55:29,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:29,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:29,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-01 09:55:29,671 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:29,678 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,678 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:29,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,678 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:29,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:29,679 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,680 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:29,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:29,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-01 09:55:29,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,682 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:29,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:29,682 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,783 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:29,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:29,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:29,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:29,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:29,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:29,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:29,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-01 09:55:29,790 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-01 09:55:29,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:29,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-01 09:55:29,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-01 09:55:29,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,790 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:29,792 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:29,792 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:29,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:29,792 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:29,792 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:29,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:29,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:29,793 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-01 09:55:29,793 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-01 09:55:29,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-01 09:55:29,794 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-01 09:55:29,794 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:29,794 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-01 09:55:29,794 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:29,794 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. started... 2023-11-01 09:55:29,794 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:29,794 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. started... 2023-11-01 09:55:29,794 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f8f2e3d3c925badce7580bd7572b250 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:55:29,794 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ce95d44a8b3e79de7f5aab9d535373ee 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:55:29,798 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:29,798 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:29,798 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:29,798 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. started... 2023-11-01 09:55:29,798 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a1270fae216de4a507f8780689d9bb05 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:55:29,816 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 2023-11-01 09:55:29,820 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/60f127267cb84b3abdac93e8ed4580d8 2023-11-01 09:55:30,217 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a 2023-11-01 09:55:30,217 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 2023-11-01 09:55:30,231 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101d2590e2b556a4cf0a5a1a954aede55e7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101d2590e2b556a4cf0a5a1a954aede55e7 2023-11-01 09:55:30,625 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/6d278ec4dced4875944605ef9f4e71b2 2023-11-01 09:55:30,625 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/d22883ff100a48f69750fe727d52bd00 2023-11-01 09:55:30,637 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/e41db25d8a694608926daf528d086cd9 2023-11-01 09:55:30,640 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/60f127267cb84b3abdac93e8ed4580d8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8 2023-11-01 09:55:30,645 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8, entries=4, sequenceid=9, filesize=5.4 K 2023-11-01 09:55:30,646 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/e41db25d8a694608926daf528d086cd9 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9 2023-11-01 09:55:30,649 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:55:30,650 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ce95d44a8b3e79de7f5aab9d535373ee in 856ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:30,650 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:30,650 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:30,650 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:31,048 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110134de8c5e4fbd48cfa1b02cbeb19d0355 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110134de8c5e4fbd48cfa1b02cbeb19d0355 2023-11-01 09:55:31,048 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101a102fc3388ac4ed794ad3c4264384eb1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a102fc3388ac4ed794ad3c4264384eb1 2023-11-01 09:55:31,090 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:55:31,453 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/8241cd158fc04d3a9f40e8dbee7c788a 2023-11-01 09:55:31,453 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/7794c8d2551a4ca6aeb54eb95707a974 2023-11-01 09:55:31,457 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/6d278ec4dced4875944605ef9f4e71b2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2 2023-11-01 09:55:31,457 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/d22883ff100a48f69750fe727d52bd00 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00 2023-11-01 09:55:31,461 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-01 09:55:31,461 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00, entries=4, sequenceid=9, filesize=5.4 K 2023-11-01 09:55:31,461 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/8241cd158fc04d3a9f40e8dbee7c788a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a 2023-11-01 09:55:31,461 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/7794c8d2551a4ca6aeb54eb95707a974 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974 2023-11-01 09:55:31,465 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:55:31,465 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:55:31,466 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6f8f2e3d3c925badce7580bd7572b250 in 1672ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:31,466 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a1270fae216de4a507f8780689d9bb05 in 1668ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:31,466 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:31,466 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:31,466 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:31,466 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-01 09:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-01 09:55:31,468 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,468 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:31,468 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,468 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:31,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:31,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-01 09:55:31,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47879d66[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:31,469 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-01 09:55:31,470 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,471 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,472 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-01 09:55:31,472 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-01 09:55:31,472 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,472 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:31,472 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:31,473 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-01 09:55:31,473 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,473 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:31,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:31,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:31,473 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-01 09:55:31,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:31,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-01 09:55:31,475 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-01 09:55:31,475 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:31,475 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:31,475 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-01 09:55:31,475 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:31,476 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,476 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:31,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,477 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:31,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:31,477 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,478 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:31,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:31,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,480 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,480 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:31,480 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:31,480 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:31,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:31,480 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:31,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:31,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-01 09:55:31,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:31,480 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,480 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:31,481 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,481 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:31,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:31,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:31,481 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,481 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:31,481 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:31,581 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:31,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:31,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:31,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:31,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:31,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-01 09:55:31,587 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-01 09:55:31,587 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:31,587 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-01 09:55:31,587 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-01 09:55:31,588 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,588 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:31,589 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:31,589 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:31,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:31,590 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:31,590 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:31,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:31,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:31,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-01 09:55:31,591 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-01 09:55:31,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-01 09:55:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-01 09:55:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-01 09:55:31,591 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:31,591 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. started... 2023-11-01 09:55:31,592 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f8f2e3d3c925badce7580bd7572b250 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:55:31,592 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:31,592 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. started... 2023-11-01 09:55:31,592 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ce95d44a8b3e79de7f5aab9d535373ee 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:55:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:31,592 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:31,593 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. started... 2023-11-01 09:55:31,593 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a1270fae216de4a507f8780689d9bb05 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:55:31,736 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-01 09:55:32,009 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc 2023-11-01 09:55:32,012 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb 2023-11-01 09:55:32,018 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 2023-11-01 09:55:32,418 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/81b0d40e0caf43a59ef82de90f34f8cc 2023-11-01 09:55:32,419 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/7292657da0a14b58a5f62f607c555d84 2023-11-01 09:55:32,422 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/6377f30930bf4bcfa1c08a32188dbbc3 2023-11-01 09:55:32,838 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311018fe37e12da4b48dda78840ca479aa938 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311018fe37e12da4b48dda78840ca479aa938 2023-11-01 09:55:32,838 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101c6876a0a6c2c4090863461b8b0e80585 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231101c6876a0a6c2c4090863461b8b0e80585 2023-11-01 09:55:32,839 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311015b80085d4bd648f8bf44ba6fa51f67d3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311015b80085d4bd648f8bf44ba6fa51f67d3 2023-11-01 09:55:32,843 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/a9ffd6dfed5b472fa56c7c9878745b14 2023-11-01 09:55:32,844 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/ac0295f43174431695fb0478ed854ffa 2023-11-01 09:55:32,852 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/81b0d40e0caf43a59ef82de90f34f8cc as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc 2023-11-01 09:55:32,853 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/6377f30930bf4bcfa1c08a32188dbbc3 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3 2023-11-01 09:55:32,856 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc, entries=4, sequenceid=13, filesize=5.4 K 2023-11-01 09:55:32,856 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3, entries=4, sequenceid=13, filesize=5.4 K 2023-11-01 09:55:32,857 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/a9ffd6dfed5b472fa56c7c9878745b14 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14 2023-11-01 09:55:32,857 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/ac0295f43174431695fb0478ed854ffa as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa 2023-11-01 09:55:32,860 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:55:32,861 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ce95d44a8b3e79de7f5aab9d535373ee in 1269ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:32,861 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:32,861 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:32,861 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:55:32,861 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:32,862 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a1270fae216de4a507f8780689d9bb05 in 1269ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:32,862 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:32,862 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:32,862 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:33,244 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/14e788f410dc491bbf218b7206498dc0 2023-11-01 09:55:33,248 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/7292657da0a14b58a5f62f607c555d84 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84 2023-11-01 09:55:33,252 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84, entries=4, sequenceid=13, filesize=5.4 K 2023-11-01 09:55:33,252 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/14e788f410dc491bbf218b7206498dc0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0 2023-11-01 09:55:33,256 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:55:33,256 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6f8f2e3d3c925badce7580bd7572b250 in 1664ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:33,257 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:33,257 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-01 09:55:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-01 09:55:33,258 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,258 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:33,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:33,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-01 09:55:33,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79be6ec8[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:33,260 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-01 09:55:33,260 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,261 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-01 09:55:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-01 09:55:33,261 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,261 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-01 09:55:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:33,266 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-01 09:55:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:33,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-01 09:55:33,268 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-01 09:55:33,268 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:33,268 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:33,268 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-01 09:55:33,268 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:33,270 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,270 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,270 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:33,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,271 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:33,272 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,273 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,273 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:33,273 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:33,273 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-01 09:55:33,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:33,273 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:33,274 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:33,274 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:33,274 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:33,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-01 09:55:33,274 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:33,274 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:33,274 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,274 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:33,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:33,374 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:33,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:33,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:33,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:33,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:33,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:33,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-01 09:55:33,381 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-01 09:55:33,382 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:33,382 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-01 09:55:33,382 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-01 09:55:33,382 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,382 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:33,383 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:33,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:33,384 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:33,384 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:33,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:33,385 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-01 09:55:33,385 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-01 09:55:33,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-01 09:55:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-01 09:55:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:33,385 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-01 09:55:33,386 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:33,386 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. started... 2023-11-01 09:55:33,386 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:33,386 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. started... 2023-11-01 09:55:33,386 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f8f2e3d3c925badce7580bd7572b250 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:55:33,386 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ce95d44a8b3e79de7f5aab9d535373ee 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:55:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:33,387 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:33,387 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. started... 2023-11-01 09:55:33,387 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a1270fae216de4a507f8780689d9bb05 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:55:33,414 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 2023-11-01 09:55:33,807 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a 2023-11-01 09:55:33,814 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea 2023-11-01 09:55:33,818 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/bf310a25a52a4b70a410eaf670380667 2023-11-01 09:55:33,818 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/f6ac77defa81451ab1d1ea9af78eb951 2023-11-01 09:55:33,832 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101a74af193b7134f9d8e10bab44166342b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a74af193b7134f9d8e10bab44166342b 2023-11-01 09:55:34,212 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/a804db85f34a4518b01f694d61cfab44 2023-11-01 09:55:34,232 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311011b8f4bbb1a0e4ba2a0d32bdd132b6eee to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311011b8f4bbb1a0e4ba2a0d32bdd132b6eee 2023-11-01 09:55:34,237 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/302207e3f8f142529ca88f4c50c28ad3 2023-11-01 09:55:34,240 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/f6ac77defa81451ab1d1ea9af78eb951 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951 2023-11-01 09:55:34,243 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951, entries=4, sequenceid=17, filesize=5.4 K 2023-11-01 09:55:34,244 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/302207e3f8f142529ca88f4c50c28ad3 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3 2023-11-01 09:55:34,247 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:55:34,247 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a1270fae216de4a507f8780689d9bb05 in 860ms, sequenceid=17, compaction requested=true 2023-11-01 09:55:34,248 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:34,248 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:34,248 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:34,625 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110154a5476894a24713a741612ab2acdbf9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110154a5476894a24713a741612ab2acdbf9 2023-11-01 09:55:34,636 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/6c9ccbf67c6149a1a2a451275ab8717c 2023-11-01 09:55:34,639 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/bf310a25a52a4b70a410eaf670380667 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667 2023-11-01 09:55:34,642 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667, entries=4, sequenceid=17, filesize=5.4 K 2023-11-01 09:55:34,643 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/6c9ccbf67c6149a1a2a451275ab8717c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c 2023-11-01 09:55:34,646 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:55:34,647 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6f8f2e3d3c925badce7580bd7572b250 in 1261ms, sequenceid=17, compaction requested=true 2023-11-01 09:55:34,647 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:34,647 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:34,647 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:35,030 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/da034b9476e64023ac3a013266aed2b0 2023-11-01 09:55:35,034 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/a804db85f34a4518b01f694d61cfab44 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44 2023-11-01 09:55:35,038 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44, entries=4, sequenceid=17, filesize=5.4 K 2023-11-01 09:55:35,038 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/da034b9476e64023ac3a013266aed2b0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0 2023-11-01 09:55:35,042 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:55:35,043 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ce95d44a8b3e79de7f5aab9d535373ee in 1657ms, sequenceid=17, compaction requested=true 2023-11-01 09:55:35,043 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:35,043 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:35,043 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:35,043 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:35,043 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,043 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-01 09:55:35,043 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-01 09:55:35,045 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,045 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:35,045 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,045 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-01 09:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b1e0947[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:35,046 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-01 09:55:35,046 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,048 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,048 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-01 09:55:35,048 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-01 09:55:35,048 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:35,049 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,049 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:35,050 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,050 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-01 09:55:35,050 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:35,050 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-01 09:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:35,052 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-01 09:55:35,052 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:35,052 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:35,052 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-01 09:55:35,052 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:35,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-01 09:55:35,054 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,054 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:35,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,054 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:35,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:35,054 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:35,055 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,057 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,057 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:35,057 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:35,057 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:35,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:35,057 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:35,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-01 09:55:35,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:35,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:35,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:35,058 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:35,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:35,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:35,158 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:35,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:35,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:35,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698832535169 (current time:1698832535169). 2023-11-01 09:55:35,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-01 09:55:35,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] zookeeper.ReadOnlyZKClient(139): Connect 0x57263cab to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:35,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f9d2736, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:35,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:35,183 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:35,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57263cab to 127.0.0.1:49762 2023-11-01 09:55:35,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:35,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-01 09:55:35,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:35,196 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot, current working dir path: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/snaptb-1698832535159 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-01 09:55:35,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-01 09:55:35,203 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-01 09:55:35,204 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698833135204 2023-11-01 09:55:35,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:35,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698832535159 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-01 09:55:35,205 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-01 09:55:35,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-01 09:55:35,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-01 09:55:35,207 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-01 09:55:35,207 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698833135207 2023-11-01 09:55:35,209 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:35,209 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-01 09:55:35,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698832535159 2023-11-01 09:55:35,221 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698832535159' 2023-11-01 09:55:35,221 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-01 09:55:35,221 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698832535159' starting 'acquire' 2023-11-01 09:55:35,221 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698832535159', kicking off acquire phase on members. 2023-11-01 09:55:35,221 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,221 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698832535159 2023-11-01 09:55:35,222 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,223 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-01 09:55:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-01 09:55:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-01 09:55:35,223 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,223 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698832535159 2023-11-01 09:55:35,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-01 09:55:35,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698832535159 2023-11-01 09:55:35,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698832535159 from table testCompactionWithHFileLink type FLUSH 2023-11-01 09:55:35,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698832535159 2023-11-01 09:55:35,227 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698832535159' with timeout 300000ms 2023-11-01 09:55:35,227 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-01 09:55:35,227 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698832535159' starting 'acquire' stage 2023-11-01 09:55:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698832535159' locally acquired 2023-11-01 09:55:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (snaptb-1698832535159) in zk 2023-11-01 09:55:35,229 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,229 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-01 09:55:35,229 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,229 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698832535159' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:35,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698832535159 2023-11-01 09:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'snaptb-1698832535159' on coordinator 2023-11-01 09:55:35,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6e503[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:35,230 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698832535159' starting 'in-barrier' execution. 2023-11-01 09:55:35,230 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,232 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,232 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698832535159' received 'reached' from coordinator. 2023-11-01 09:55:35,232 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,233 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:35,233 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:35,233 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-01 09:55:35,233 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:35,233 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-01 09:55:35,233 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:35,234 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. started... 2023-11-01 09:55:35,234 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. started... 2023-11-01 09:55:35,234 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. started... 2023-11-01 09:55:35,234 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:35,234 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:35,234 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:35,235 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.' region-info for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,235 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.' region-info for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,235 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.' region-info for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,374 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:35,375 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-01 09:55:35,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:35,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:35,380 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-01 09:55:35,381 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-01 09:55:35,381 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-01 09:55:35,381 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-01 09:55:35,384 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44] hfiles 2023-11-01 09:55:35,384 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667] hfiles 2023-11-01 09:55:35,384 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951] hfiles 2023-11-01 09:55:35,384 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,384 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,384 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,387 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,387 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,387 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3] hfiles 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0] hfiles 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c] hfiles 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3 for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,388 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,580 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:35,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:35,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:35,581 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-01 09:55:35,800 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. completed. 2023-11-01 09:55:35,800 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:35,800 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-01 09:55:35,802 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. completed. 2023-11-01 09:55:35,802 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:35,802 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-01 09:55:35,806 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. completed. 2023-11-01 09:55:35,806 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:35,806 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-01 09:55:35,806 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-01 09:55:35,806 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,807 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698832535159' locally completed 2023-11-01 09:55:35,807 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698832535159' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698832535159' has notified controller of completion 2023-11-01 09:55:35,808 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:35,808 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698832535159' completed. 2023-11-01 09:55:35,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:35,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-01 09:55:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698832535159 2023-11-01 09:55:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698832535159 2023-11-01 09:55:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698832535159' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:35,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'snaptb-1698832535159', counting down latch. Waiting for 0 more 2023-11-01 09:55:35,811 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698832535159' execution completed 2023-11-01 09:55:35,811 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:35,811 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:35,811 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698832535159 2023-11-01 09:55:35,811 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698832535159including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-01 09:55:35,812 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,812 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,812 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-01 09:55:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-01 09:55:35,813 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-01 09:55:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-01 09:55:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698832535159 2023-11-01 09:55:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698832535159 2023-11-01 09:55:35,814 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698832535159 2023-11-01 09:55:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698832535159 2023-11-01 09:55:35,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-01 09:55:35,816 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698832535159 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698832535159/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:35,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698832535159 2023-11-01 09:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698832535159 2023-11-01 09:55:35,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698832535159 2023-11-01 09:55:35,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698832535159 2023-11-01 09:55:35,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-01 09:55:35,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-01 09:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6] mob files 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 2023-11-01 09:55:35,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311010adc5c82ccc946e7b5dbd1072faaf0e9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311011b8f4bbb1a0e4ba2a0d32bdd132b6eee, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110134de8c5e4fbd48cfa1b02cbeb19d0355, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231101c6876a0a6c2c4090863461b8b0e80585, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311015b80085d4bd648f8bf44ba6fa51f67d3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a102fc3388ac4ed794ad3c4264384eb1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a74af193b7134f9d8e10bab44166342b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101e8e51e3b009e40799cf69cd49a2a9b7f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110154a5476894a24713a741612ab2acdbf9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311018fe37e12da4b48dda78840ca479aa938, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101b378a8901c9f473badda5377d50e9c82, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101d2590e2b556a4cf0a5a1a954aede55e7] mob files 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311010adc5c82ccc946e7b5dbd1072faaf0e9 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311011b8f4bbb1a0e4ba2a0d32bdd132b6eee 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110134de8c5e4fbd48cfa1b02cbeb19d0355 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231101c6876a0a6c2c4090863461b8b0e80585 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311015b80085d4bd648f8bf44ba6fa51f67d3 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a102fc3388ac4ed794ad3c4264384eb1 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a74af193b7134f9d8e10bab44166342b 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101e8e51e3b009e40799cf69cd49a2a9b7f 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110154a5476894a24713a741612ab2acdbf9 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311018fe37e12da4b48dda78840ca479aa938 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101b378a8901c9f473badda5377d50e9c82 2023-11-01 09:55:35,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101d2590e2b556a4cf0a5a1a954aede55e7 2023-11-01 09:55:35,881 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:35,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:35,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:35,882 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-01 09:55:36,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698832535159 2023-11-01 09:55:36,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/snaptb-1698832535159 2023-11-01 09:55:36,383 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:36,384 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-01 09:55:36,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/snaptb-1698832535159 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/snaptb-1698832535159 2023-11-01 09:55:36,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698832535159 of table testCompactionWithHFileLink completed 2023-11-01 09:55:36,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/snaptb-1698832535159 2023-11-01 09:55:36,667 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/snaptb-1698832535159 2023-11-01 09:55:36,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698832535159 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698832535204Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698832536224 (+1020 ms)Consolidate snapshot: snaptb-1698832535159 at 1698832536224Loading Region manifests for snaptb-1698832535159 at 1698832536225 (+1 ms)Writing data manifest for snaptb-1698832535159 at 1698832536235 (+10 ms)Verifying snapshot: snaptb-1698832535159 at 1698832536642 (+407 ms)Snapshot snaptb-1698832535159 of table testCompactionWithHFileLink completed at 1698832536667 (+25 ms) 2023-11-01 09:55:36,668 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-01 09:55:36,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.4630 sec 2023-11-01 09:55:37,239 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:55:37,384 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:37,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:37,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-01 09:55:37,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:37,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:37,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-01 09:55:37,415 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-01 09:55:37,415 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:37,415 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-01 09:55:37,415 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-01 09:55:37,415 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:37,415 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:37,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:37,417 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:37,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:37,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:37,417 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:37,418 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:37,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:37,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-01 09:55:37,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-01 09:55:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-01 09:55:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-01 09:55:37,419 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:37,419 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:37,419 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. started... 2023-11-01 09:55:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:37,419 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f8f2e3d3c925badce7580bd7572b250 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:55:37,419 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:37,419 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. started... 2023-11-01 09:55:37,419 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. started... 2023-11-01 09:55:37,419 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ce95d44a8b3e79de7f5aab9d535373ee 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:55:37,419 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a1270fae216de4a507f8780689d9bb05 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:55:37,434 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/6e4b31ce70c74d099746f84bbdbb6775 2023-11-01 09:55:37,437 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e4b31ce70c74d099746f84bbdbb6775 2023-11-01 09:55:37,835 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/e50b86fe35b6469083e3bc9fcce6cd57 2023-11-01 09:55:37,838 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e50b86fe35b6469083e3bc9fcce6cd57 2023-11-01 09:55:37,848 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/44f8513c98c84653823703d6c1d6fc49 2023-11-01 09:55:37,851 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44f8513c98c84653823703d6c1d6fc49 2023-11-01 09:55:37,852 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/6e4b31ce70c74d099746f84bbdbb6775 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6e4b31ce70c74d099746f84bbdbb6775 2023-11-01 09:55:37,855 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e4b31ce70c74d099746f84bbdbb6775 2023-11-01 09:55:37,855 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6e4b31ce70c74d099746f84bbdbb6775, entries=3, sequenceid=24, filesize=5.0 K 2023-11-01 09:55:37,855 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/44f8513c98c84653823703d6c1d6fc49 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/44f8513c98c84653823703d6c1d6fc49 2023-11-01 09:55:37,859 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44f8513c98c84653823703d6c1d6fc49 2023-11-01 09:55:37,859 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/44f8513c98c84653823703d6c1d6fc49, entries=1, sequenceid=24, filesize=5.0 K 2023-11-01 09:55:37,859 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a1270fae216de4a507f8780689d9bb05 in 440ms, sequenceid=24, compaction requested=true 2023-11-01 09:55:37,859 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:37,860 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:38,235 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/4cd4de159c7540c4b62e0a10ad4e5691 2023-11-01 09:55:38,239 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cd4de159c7540c4b62e0a10ad4e5691 2023-11-01 09:55:38,649 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/64ec6f1f40b64a43a74464be2e515fa2 2023-11-01 09:55:38,653 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64ec6f1f40b64a43a74464be2e515fa2 2023-11-01 09:55:38,653 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/e50b86fe35b6469083e3bc9fcce6cd57 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/e50b86fe35b6469083e3bc9fcce6cd57 2023-11-01 09:55:38,657 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e50b86fe35b6469083e3bc9fcce6cd57 2023-11-01 09:55:38,657 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/e50b86fe35b6469083e3bc9fcce6cd57, entries=3, sequenceid=24, filesize=5.0 K 2023-11-01 09:55:38,657 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/64ec6f1f40b64a43a74464be2e515fa2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/64ec6f1f40b64a43a74464be2e515fa2 2023-11-01 09:55:38,661 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64ec6f1f40b64a43a74464be2e515fa2 2023-11-01 09:55:38,661 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/64ec6f1f40b64a43a74464be2e515fa2, entries=1, sequenceid=24, filesize=5.0 K 2023-11-01 09:55:38,661 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ce95d44a8b3e79de7f5aab9d535373ee in 1242ms, sequenceid=24, compaction requested=true 2023-11-01 09:55:38,662 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:38,662 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:38,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:39,051 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/e4531c0d81ec47318df3632bf47d1383 2023-11-01 09:55:39,055 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4531c0d81ec47318df3632bf47d1383 2023-11-01 09:55:39,056 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/4cd4de159c7540c4b62e0a10ad4e5691 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/4cd4de159c7540c4b62e0a10ad4e5691 2023-11-01 09:55:39,059 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cd4de159c7540c4b62e0a10ad4e5691 2023-11-01 09:55:39,059 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/4cd4de159c7540c4b62e0a10ad4e5691, entries=3, sequenceid=24, filesize=5.0 K 2023-11-01 09:55:39,060 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/e4531c0d81ec47318df3632bf47d1383 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/e4531c0d81ec47318df3632bf47d1383 2023-11-01 09:55:39,064 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4531c0d81ec47318df3632bf47d1383 2023-11-01 09:55:39,064 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/e4531c0d81ec47318df3632bf47d1383, entries=1, sequenceid=24, filesize=5.0 K 2023-11-01 09:55:39,065 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6f8f2e3d3c925badce7580bd7572b250 in 1646ms, sequenceid=24, compaction requested=true 2023-11-01 09:55:39,065 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:39,065 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-01 09:55:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-01 09:55:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,066 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:39,067 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,067 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:39,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-01 09:55:39,068 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-01 09:55:39,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bc134d2[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:39,068 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,072 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-01 09:55:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-01 09:55:39,072 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,072 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:39,073 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-01 09:55:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-01 09:55:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:39,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-01 09:55:39,076 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-01 09:55:39,076 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:39,076 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:39,076 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-01 09:55:39,076 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:39,077 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,077 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,077 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:39,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,078 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:39,079 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:39,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-01 09:55:39,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:39,082 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:39,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-01 09:55:39,082 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-01 09:55:39,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:39,083 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-01 09:55:39,083 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:39,083 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:39,183 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:39,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:39,184 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:39,184 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 6f8f2e3d3c925badce7580bd7572b250/family1 is initiating major compaction (all files) 2023-11-01 09:55:39,185 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:55:39,185 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:55:39,185 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 6f8f2e3d3c925badce7580bd7572b250/family1 in testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:39,185 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/4cd4de159c7540c4b62e0a10ad4e5691] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp, totalSize=26.7 K 2023-11-01 09:55:39,186 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 7601c27a248446958d3a299270c4996a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527983 2023-11-01 09:55:39,186 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting d22883ff100a48f69750fe727d52bd00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:39,186 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 7292657da0a14b58a5f62f607c555d84, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:39,187 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting bf310a25a52a4b70a410eaf670380667, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:39,187 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 4cd4de159c7540c4b62e0a10ad4e5691, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-01 09:55:39,199 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 6f8f2e3d3c925badce7580bd7572b250#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:55:39,607 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del 2023-11-01 09:55:39,607 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del 2023-11-01 09:55:40,419 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98eefac7cf344b78aec7cdb364c6d9ab 2023-11-01 09:55:40,420 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/98eefac7cf344b78aec7cdb364c6d9ab as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/98eefac7cf344b78aec7cdb364c6d9ab 2023-11-01 09:55:40,424 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98eefac7cf344b78aec7cdb364c6d9ab 2023-11-01 09:55:40,425 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6f8f2e3d3c925badce7580bd7572b250/family1 of 6f8f2e3d3c925badce7580bd7572b250 into 98eefac7cf344b78aec7cdb364c6d9ab(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:40,425 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:40,425 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:40,425 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 6f8f2e3d3c925badce7580bd7572b250/family2 is initiating major compaction (all files) 2023-11-01 09:55:40,425 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:55:40,425 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:55:40,426 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 6f8f2e3d3c925badce7580bd7572b250/family2 in testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:40,426 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/e4531c0d81ec47318df3632bf47d1383] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp, totalSize=25.4 K 2023-11-01 09:55:40,427 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 55607dfd0f954410a7929868c1f853ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527983 2023-11-01 09:55:40,427 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 7794c8d2551a4ca6aeb54eb95707a974, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:40,427 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 14e788f410dc491bbf218b7206498dc0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:40,428 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6c9ccbf67c6149a1a2a451275ab8717c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:40,428 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e4531c0d81ec47318df3632bf47d1383, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-01 09:55:40,438 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 6f8f2e3d3c925badce7580bd7572b250#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:55:40,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/4cd4de159c7540c4b62e0a10ad4e5691] to archive 2023-11-01 09:55:40,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:40,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7601c27a248446958d3a299270c4996a 2023-11-01 09:55:40,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/d22883ff100a48f69750fe727d52bd00 2023-11-01 09:55:40,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/7292657da0a14b58a5f62f607c555d84 2023-11-01 09:55:40,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/bf310a25a52a4b70a410eaf670380667 2023-11-01 09:55:40,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/4cd4de159c7540c4b62e0a10ad4e5691 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/4cd4de159c7540c4b62e0a10ad4e5691 2023-11-01 09:55:40,850 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del 2023-11-01 09:55:40,850 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del 2023-11-01 09:55:41,662 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92a241d917ec49aab7d0eef2e4c9742e 2023-11-01 09:55:41,663 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/92a241d917ec49aab7d0eef2e4c9742e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/92a241d917ec49aab7d0eef2e4c9742e 2023-11-01 09:55:41,667 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92a241d917ec49aab7d0eef2e4c9742e 2023-11-01 09:55:41,668 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6f8f2e3d3c925badce7580bd7572b250/family2 of 6f8f2e3d3c925badce7580bd7572b250 into 92a241d917ec49aab7d0eef2e4c9742e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:41,668 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:41,668 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:41,668 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): ce95d44a8b3e79de7f5aab9d535373ee/family1 is initiating major compaction (all files) 2023-11-01 09:55:41,668 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:55:41,668 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:55:41,668 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of ce95d44a8b3e79de7f5aab9d535373ee/family1 in testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:41,668 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/e50b86fe35b6469083e3bc9fcce6cd57] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp, totalSize=26.7 K 2023-11-01 09:55:41,669 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 172b5f58fc4a4029b6a3e2e461d76e01, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527982 2023-11-01 09:55:41,669 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 60f127267cb84b3abdac93e8ed4580d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529784 2023-11-01 09:55:41,669 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 81b0d40e0caf43a59ef82de90f34f8cc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:41,670 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting a804db85f34a4518b01f694d61cfab44, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533376 2023-11-01 09:55:41,670 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e50b86fe35b6469083e3bc9fcce6cd57, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-01 09:55:41,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/e4531c0d81ec47318df3632bf47d1383] to archive 2023-11-01 09:55:41,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:41,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/55607dfd0f954410a7929868c1f853ed 2023-11-01 09:55:41,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/7794c8d2551a4ca6aeb54eb95707a974 2023-11-01 09:55:41,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/14e788f410dc491bbf218b7206498dc0 2023-11-01 09:55:41,681 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): ce95d44a8b3e79de7f5aab9d535373ee#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:55:41,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/6c9ccbf67c6149a1a2a451275ab8717c 2023-11-01 09:55:41,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/e4531c0d81ec47318df3632bf47d1383 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/e4531c0d81ec47318df3632bf47d1383 2023-11-01 09:55:42,091 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del 2023-11-01 09:55:42,091 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del 2023-11-01 09:55:42,912 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b81a08b59c74220a2621d8e25b18416 2023-11-01 09:55:42,913 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/0b81a08b59c74220a2621d8e25b18416 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/0b81a08b59c74220a2621d8e25b18416 2023-11-01 09:55:42,917 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b81a08b59c74220a2621d8e25b18416 2023-11-01 09:55:42,918 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ce95d44a8b3e79de7f5aab9d535373ee/family1 of ce95d44a8b3e79de7f5aab9d535373ee into 0b81a08b59c74220a2621d8e25b18416(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:42,918 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:42,918 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:42,918 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): ce95d44a8b3e79de7f5aab9d535373ee/family2 is initiating major compaction (all files) 2023-11-01 09:55:42,918 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:55:42,918 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:55:42,918 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of ce95d44a8b3e79de7f5aab9d535373ee/family2 in testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:42,919 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/64ec6f1f40b64a43a74464be2e515fa2] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp, totalSize=25.4 K 2023-11-01 09:55:42,919 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 968dc0f7a48f4cab98e19e18ed3f7314, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527982 2023-11-01 09:55:42,920 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e41db25d8a694608926daf528d086cd9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529784 2023-11-01 09:55:42,920 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting a9ffd6dfed5b472fa56c7c9878745b14, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:42,921 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting da034b9476e64023ac3a013266aed2b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533376 2023-11-01 09:55:42,921 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 64ec6f1f40b64a43a74464be2e515fa2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-01 09:55:42,935 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): ce95d44a8b3e79de7f5aab9d535373ee#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:55:42,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/e50b86fe35b6469083e3bc9fcce6cd57] to archive 2023-11-01 09:55:42,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:42,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/172b5f58fc4a4029b6a3e2e461d76e01 2023-11-01 09:55:42,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/60f127267cb84b3abdac93e8ed4580d8 2023-11-01 09:55:42,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/81b0d40e0caf43a59ef82de90f34f8cc 2023-11-01 09:55:42,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/a804db85f34a4518b01f694d61cfab44 2023-11-01 09:55:42,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/e50b86fe35b6469083e3bc9fcce6cd57 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/e50b86fe35b6469083e3bc9fcce6cd57 2023-11-01 09:55:43,349 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del 2023-11-01 09:55:43,349 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del 2023-11-01 09:55:44,163 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1fed3028b6a4a5f9109593b790cddb4 2023-11-01 09:55:44,164 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/a1fed3028b6a4a5f9109593b790cddb4 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a1fed3028b6a4a5f9109593b790cddb4 2023-11-01 09:55:44,167 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1fed3028b6a4a5f9109593b790cddb4 2023-11-01 09:55:44,168 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ce95d44a8b3e79de7f5aab9d535373ee/family2 of ce95d44a8b3e79de7f5aab9d535373ee into a1fed3028b6a4a5f9109593b790cddb4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:44,168 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:44,168 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:44,168 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): a1270fae216de4a507f8780689d9bb05/family1 is initiating major compaction (all files) 2023-11-01 09:55:44,169 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:55:44,169 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:55:44,169 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of a1270fae216de4a507f8780689d9bb05/family1 in testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:44,169 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6e4b31ce70c74d099746f84bbdbb6775] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp, totalSize=26.7 K 2023-11-01 09:55:44,169 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 8aff520de3e741289910198c4ddd903b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527984 2023-11-01 09:55:44,170 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6d278ec4dced4875944605ef9f4e71b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:44,170 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6377f30930bf4bcfa1c08a32188dbbc3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:44,170 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting f6ac77defa81451ab1d1ea9af78eb951, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:44,171 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6e4b31ce70c74d099746f84bbdbb6775, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-01 09:55:44,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/64ec6f1f40b64a43a74464be2e515fa2] to archive 2023-11-01 09:55:44,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:44,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/968dc0f7a48f4cab98e19e18ed3f7314 2023-11-01 09:55:44,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/e41db25d8a694608926daf528d086cd9 2023-11-01 09:55:44,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a9ffd6dfed5b472fa56c7c9878745b14 2023-11-01 09:55:44,181 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): a1270fae216de4a507f8780689d9bb05#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:55:44,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/da034b9476e64023ac3a013266aed2b0 2023-11-01 09:55:44,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/64ec6f1f40b64a43a74464be2e515fa2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/64ec6f1f40b64a43a74464be2e515fa2 2023-11-01 09:55:44,589 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del 2023-11-01 09:55:44,589 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del 2023-11-01 09:55:45,405 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 577b785541584d8d889ad1e049a0b469 2023-11-01 09:55:45,406 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/577b785541584d8d889ad1e049a0b469 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/577b785541584d8d889ad1e049a0b469 2023-11-01 09:55:45,410 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 577b785541584d8d889ad1e049a0b469 2023-11-01 09:55:45,411 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a1270fae216de4a507f8780689d9bb05/family1 of a1270fae216de4a507f8780689d9bb05 into 577b785541584d8d889ad1e049a0b469(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:45,411 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:45,411 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:45,411 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): a1270fae216de4a507f8780689d9bb05/family2 is initiating major compaction (all files) 2023-11-01 09:55:45,411 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:55:45,411 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:55:45,411 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of a1270fae216de4a507f8780689d9bb05/family2 in testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:45,411 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/44f8513c98c84653823703d6c1d6fc49] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp, totalSize=25.4 K 2023-11-01 09:55:45,412 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6ca4e2695fea44ef896f32344bb250d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527984 2023-11-01 09:55:45,412 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 8241cd158fc04d3a9f40e8dbee7c788a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:45,412 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting ac0295f43174431695fb0478ed854ffa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:45,413 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 302207e3f8f142529ca88f4c50c28ad3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:45,413 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 44f8513c98c84653823703d6c1d6fc49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-01 09:55:45,424 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): a1270fae216de4a507f8780689d9bb05#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:55:45,432 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del 2023-11-01 09:55:45,432 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del 2023-11-01 09:55:45,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6e4b31ce70c74d099746f84bbdbb6775] to archive 2023-11-01 09:55:45,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:45,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/8aff520de3e741289910198c4ddd903b 2023-11-01 09:55:45,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6d278ec4dced4875944605ef9f4e71b2 2023-11-01 09:55:45,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6377f30930bf4bcfa1c08a32188dbbc3 2023-11-01 09:55:45,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/f6ac77defa81451ab1d1ea9af78eb951 2023-11-01 09:55:45,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6e4b31ce70c74d099746f84bbdbb6775 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/6e4b31ce70c74d099746f84bbdbb6775 2023-11-01 09:55:46,245 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5125c8cfa17149a9936dc848587f0d50 2023-11-01 09:55:46,246 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/5125c8cfa17149a9936dc848587f0d50 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/5125c8cfa17149a9936dc848587f0d50 2023-11-01 09:55:46,250 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5125c8cfa17149a9936dc848587f0d50 2023-11-01 09:55:46,251 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a1270fae216de4a507f8780689d9bb05/family2 of a1270fae216de4a507f8780689d9bb05 into 5125c8cfa17149a9936dc848587f0d50(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:55:46,251 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:46,256 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:46,259 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:46,263 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:46,264 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:46,269 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-01 09:55:46,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/44f8513c98c84653823703d6c1d6fc49] to archive 2023-11-01 09:55:46,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/6ca4e2695fea44ef896f32344bb250d2 2023-11-01 09:55:46,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/8241cd158fc04d3a9f40e8dbee7c788a 2023-11-01 09:55:46,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/ac0295f43174431695fb0478ed854ffa 2023-11-01 09:55:46,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/302207e3f8f142529ca88f4c50c28ad3 2023-11-01 09:55:46,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/44f8513c98c84653823703d6c1d6fc49 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/44f8513c98c84653823703d6c1d6fc49 2023-11-01 09:55:46,301 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-01 09:55:46,304 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del 2023-11-01 09:55:46,307 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del 2023-11-01 09:55:46,310 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del 2023-11-01 09:55:46,310 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,311 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(139): Connect 0x6912cabe to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:46,316 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dad775d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:46,316 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,316 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,316 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,393 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311018ee5663259a3473685e86b2b67f78c0f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311018ee5663259a3473685e86b2b67f78c0f 2023-11-01 09:55:46,394 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,413 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:46,417 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:46,424 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:55:46,426 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:55:46,434 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/0149d9c14c6c4999ae052ac9ff1d9c65 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-01 09:55:46,434 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/0149d9c14c6c4999ae052ac9ff1d9c65}] 2023-11-01 09:55:46,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/0149d9c14c6c4999ae052ac9ff1d9c65 for inclusion in 6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:46,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-01 09:55:46,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-01 09:55:46,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:46,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/0149d9c14c6c4999ae052ac9ff1d9c65 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__4pb9tecp91m1eqkfdm1movlk5i5marfbjannn5sf2f58n4f46jid7rpqb4r84p68/family1/0149d9c14c6c4999ae052ac9ff1d9c65 2023-11-01 09:55:46,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__4pb9tecp91m1eqkfdm1movlk5i5marfbjannn5sf2f58n4f46jid7rpqb4r84p68/family1/0149d9c14c6c4999ae052ac9ff1d9c65 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_ 2023-11-01 09:55:46,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__4pb9tecp91m1eqkfdm1movlk5i5marfbjannn5sf2f58n4f46jid7rpqb4r84p68/family1/0149d9c14c6c4999ae052ac9ff1d9c65 into 6f8f2e3d3c925badce7580bd7572b250/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_ - updating store file list. 2023-11-01 09:55:46,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_ into 6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:46,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__4pb9tecp91m1eqkfdm1movlk5i5marfbjannn5sf2f58n4f46jid7rpqb4r84p68/family1/0149d9c14c6c4999ae052ac9ff1d9c65 into 6f8f2e3d3c925badce7580bd7572b250/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_) 2023-11-01 09:55:46,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__4pb9tecp91m1eqkfdm1movlk5i5marfbjannn5sf2f58n4f46jid7rpqb4r84p68/family1/0149d9c14c6c4999ae052ac9ff1d9c65 2023-11-01 09:55:46,448 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,448 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,449 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a 2023-11-01 09:55:46,450 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d 2023-11-01 09:55:46,451 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb 2023-11-01 09:55:46,452 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea 2023-11-01 09:55:46,452 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-01 09:55:46,452 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101' 2023-11-01 09:55:46,452 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,795 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311013535acecd81a4b6d9fd950bc33464206 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311013535acecd81a4b6d9fd950bc33464206 2023-11-01 09:55:46,796 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311012e0690408c3c4bbfbba9ee3e373b6d66 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311012e0690408c3c4bbfbba9ee3e373b6d66 2023-11-01 09:55:46,796 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,797 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,826 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/40c00f757e384305bce38ad2ab61e1d8 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-01 09:55:46,834 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/40c00f757e384305bce38ad2ab61e1d8}] 2023-11-01 09:55:46,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/40c00f757e384305bce38ad2ab61e1d8 for inclusion in ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:46,841 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/3c3cfbb72ac8433796a1fce970cb0397 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-01 09:55:46,842 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/3c3cfbb72ac8433796a1fce970cb0397}] 2023-11-01 09:55:46,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-01 09:55:46,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last=1 2023-11-01 09:55:46,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:46,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/40c00f757e384305bce38ad2ab61e1d8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__a2tm65t6n38a6l6op6153h1g58u99r6a1m29q1miljglj9gmvl7ikhihi7ra3dv1/family1/40c00f757e384305bce38ad2ab61e1d8 2023-11-01 09:55:46,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/3c3cfbb72ac8433796a1fce970cb0397 for inclusion in a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__a2tm65t6n38a6l6op6153h1g58u99r6a1m29q1miljglj9gmvl7ikhihi7ra3dv1/family1/40c00f757e384305bce38ad2ab61e1d8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_ 2023-11-01 09:55:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-01 09:55:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-01 09:55:46,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:46,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__a2tm65t6n38a6l6op6153h1g58u99r6a1m29q1miljglj9gmvl7ikhihi7ra3dv1/family1/40c00f757e384305bce38ad2ab61e1d8 into ce95d44a8b3e79de7f5aab9d535373ee/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_ - updating store file list. 2023-11-01 09:55:46,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/3c3cfbb72ac8433796a1fce970cb0397 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__jkaiod7f3l0mnhccsqlrn351pt4cd9blhquhvscnn25f9rqvobc8ms1r8ppv5r59/family1/3c3cfbb72ac8433796a1fce970cb0397 2023-11-01 09:55:46,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__jkaiod7f3l0mnhccsqlrn351pt4cd9blhquhvscnn25f9rqvobc8ms1r8ppv5r59/family1/3c3cfbb72ac8433796a1fce970cb0397 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_ 2023-11-01 09:55:46,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__jkaiod7f3l0mnhccsqlrn351pt4cd9blhquhvscnn25f9rqvobc8ms1r8ppv5r59/family1/3c3cfbb72ac8433796a1fce970cb0397 into a1270fae216de4a507f8780689d9bb05/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_ - updating store file list. 2023-11-01 09:55:46,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_ into ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:46,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__a2tm65t6n38a6l6op6153h1g58u99r6a1m29q1miljglj9gmvl7ikhihi7ra3dv1/family1/40c00f757e384305bce38ad2ab61e1d8 into ce95d44a8b3e79de7f5aab9d535373ee/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_) 2023-11-01 09:55:46,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__a2tm65t6n38a6l6op6153h1g58u99r6a1m29q1miljglj9gmvl7ikhihi7ra3dv1/family1/40c00f757e384305bce38ad2ab61e1d8 2023-11-01 09:55:46,854 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,855 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_ into a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:46,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__jkaiod7f3l0mnhccsqlrn351pt4cd9blhquhvscnn25f9rqvobc8ms1r8ppv5r59/family1/3c3cfbb72ac8433796a1fce970cb0397 into a1270fae216de4a507f8780689d9bb05/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_) 2023-11-01 09:55:46,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__jkaiod7f3l0mnhccsqlrn351pt4cd9blhquhvscnn25f9rqvobc8ms1r8ppv5r59/family1/3c3cfbb72ac8433796a1fce970cb0397 2023-11-01 09:55:46,857 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc 2023-11-01 09:55:46,858 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,858 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a 2023-11-01 09:55:46,858 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,859 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 2023-11-01 09:55:46,860 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba 2023-11-01 09:55:46,861 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 2023-11-01 09:55:46,861 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-01 09:55:46,861 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101' 2023-11-01 09:55:46,861 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,862 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 2023-11-01 09:55:46,866 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 2023-11-01 09:55:46,867 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 2023-11-01 09:55:46,867 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-01 09:55:46,867 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101' 2023-11-01 09:55:46,868 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,868 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:46,868 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:46,868 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del] 2023-11-01 09:55:46,869 DEBUG [Listener at localhost/37085] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,870 DEBUG [Listener at localhost/37085] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231101af9164910f324eb1839449b2213e597a_del 2023-11-01 09:55:46,870 INFO [Listener at localhost/37085] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-01 09:55:46,870 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del] 2023-11-01 09:55:46,871 DEBUG [Listener at localhost/37085] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,872 DEBUG [Listener at localhost/37085] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231101c1275dd2f1fd4447b54d488d960f83a4_del 2023-11-01 09:55:46,872 INFO [Listener at localhost/37085] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-01 09:55:46,872 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del] 2023-11-01 09:55:46,872 DEBUG [Listener at localhost/37085] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:46,874 DEBUG [Listener at localhost/37085] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231101f73c25455f704bf19994290fb6ad5f40_del 2023-11-01 09:55:46,874 INFO [Listener at localhost/37085] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-01 09:55:46,878 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:46,881 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:46,885 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:46,886 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:46,893 INFO [Listener at localhost/37085] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-01 09:55:46,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-01 09:55:46,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-01 09:55:46,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-01 09:55:46,897 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832546897"}]},"ts":"1698832546897"} 2023-11-01 09:55:46,898 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-01 09:55:46,900 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-01 09:55:46,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, UNASSIGN}] 2023-11-01 09:55:46,902 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, UNASSIGN 2023-11-01 09:55:46,902 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, UNASSIGN 2023-11-01 09:55:46,902 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, UNASSIGN 2023-11-01 09:55:46,903 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a1270fae216de4a507f8780689d9bb05, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:46,903 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832546902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832546902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832546902"}]},"ts":"1698832546902"} 2023-11-01 09:55:46,903 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6f8f2e3d3c925badce7580bd7572b250, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:46,903 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832546903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832546903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832546903"}]},"ts":"1698832546903"} 2023-11-01 09:55:46,904 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=ce95d44a8b3e79de7f5aab9d535373ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:46,904 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832546904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832546904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832546904"}]},"ts":"1698832546904"} 2023-11-01 09:55:46,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:46,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:46,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:46,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-01 09:55:47,010 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,40233,1698832432817, timeout=1698832547056, delay=46, operations=[pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817, pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817, pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817]] 2023-11-01 09:55:47,056 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:47,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:47,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f8f2e3d3c925badce7580bd7572b250, disabling compactions & flushes 2023-11-01 09:55:47,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:47,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:47,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. after waiting 0 ms 2023-11-01 09:55:47,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:47,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-01 09:55:47,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:47,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:47,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:47,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:47,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce95d44a8b3e79de7f5aab9d535373ee, disabling compactions & flushes 2023-11-01 09:55:47,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:47,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:47,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. after waiting 0 ms 2023-11-01 09:55:47,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:47,063 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6f8f2e3d3c925badce7580bd7572b250, regionState=CLOSED 2023-11-01 09:55:47,063 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832547063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832547063"}]},"ts":"1698832547063"} 2023-11-01 09:55:47,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=90 2023-11-01 09:55:47,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817 in 158 msec 2023-11-01 09:55:47,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, UNASSIGN in 166 msec 2023-11-01 09:55:47,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-01 09:55:47,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:47,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:47,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:47,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:47,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1270fae216de4a507f8780689d9bb05, disabling compactions & flushes 2023-11-01 09:55:47,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:47,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:47,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. after waiting 0 ms 2023-11-01 09:55:47,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:47,069 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=ce95d44a8b3e79de7f5aab9d535373ee, regionState=CLOSED 2023-11-01 09:55:47,069 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832547069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832547069"}]},"ts":"1698832547069"} 2023-11-01 09:55:47,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-01 09:55:47,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817 in 165 msec 2023-11-01 09:55:47,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, UNASSIGN in 171 msec 2023-11-01 09:55:47,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-01 09:55:47,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:47,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:47,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:47,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a1270fae216de4a507f8780689d9bb05, regionState=CLOSED 2023-11-01 09:55:47,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832547074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832547074"}]},"ts":"1698832547074"} 2023-11-01 09:55:47,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-11-01 09:55:47,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817 in 171 msec 2023-11-01 09:55:47,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=88 2023-11-01 09:55:47,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, UNASSIGN in 176 msec 2023-11-01 09:55:47,078 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832547078"}]},"ts":"1698832547078"} 2023-11-01 09:55:47,079 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-01 09:55:47,081 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-01 09:55:47,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 187 msec 2023-11-01 09:55:47,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-01 09:55:47,198 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-01 09:55:47,210 INFO [Listener at localhost/37085] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:47,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:47,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698832547210 (current time:1698832547210). 2023-11-01 09:55:47,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-01 09:55:47,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] zookeeper.ReadOnlyZKClient(139): Connect 0x60c5a162 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:47,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2791463b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:47,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:47,218 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:47,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60c5a162 to 127.0.0.1:49762 2023-11-01 09:55:47,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:55:47,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-01 09:55:47,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:47,221 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot, current working dir path: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698832535159-1698832547210 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-01 09:55:47,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-01 09:55:47,224 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-01 09:55:47,225 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698833147225 2023-11-01 09:55:47,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:47,225 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698832535159-1698832547210 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-01 09:55:47,225 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:47,225 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-01 09:55:47,325 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:47,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:47,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:47,327 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-01 09:55:47,527 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:47,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:47,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:47,528 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-01 09:55:47,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-01 09:55:47,646 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/98eefac7cf344b78aec7cdb364c6d9ab] hfiles 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/0b81a08b59c74220a2621d8e25b18416, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_] hfiles 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_ 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/577b785541584d8d889ad1e049a0b469, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_] hfiles 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/98eefac7cf344b78aec7cdb364c6d9ab 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/577b785541584d8d889ad1e049a0b469 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/0b81a08b59c74220a2621d8e25b18416 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_ 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_ 2023-11-01 09:55:47,649 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311018ee5663259a3473685e86b2b67f78c0f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311013535acecd81a4b6d9fd950bc33464206, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311012e0690408c3c4bbfbba9ee3e373b6d66] hfiles 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311018ee5663259a3473685e86b2b67f78c0f 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311013535acecd81a4b6d9fd950bc33464206 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311012e0690408c3c4bbfbba9ee3e373b6d66 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/92a241d917ec49aab7d0eef2e4c9742e] hfiles 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/5125c8cfa17149a9936dc848587f0d50] hfiles 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a1fed3028b6a4a5f9109593b790cddb4] hfiles 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/5125c8cfa17149a9936dc848587f0d50 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/92a241d917ec49aab7d0eef2e4c9742e 2023-11-01 09:55:47,650 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a1fed3028b6a4a5f9109593b790cddb4 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311010adc5c82ccc946e7b5dbd1072faaf0e9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311011b8f4bbb1a0e4ba2a0d32bdd132b6eee, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110134de8c5e4fbd48cfa1b02cbeb19d0355, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231101c6876a0a6c2c4090863461b8b0e80585, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311015b80085d4bd648f8bf44ba6fa51f67d3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a102fc3388ac4ed794ad3c4264384eb1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a74af193b7134f9d8e10bab44166342b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101e8e51e3b009e40799cf69cd49a2a9b7f, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110154a5476894a24713a741612ab2acdbf9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311018fe37e12da4b48dda78840ca479aa938, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101b378a8901c9f473badda5377d50e9c82, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101d2590e2b556a4cf0a5a1a954aede55e7] hfiles 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311010adc5c82ccc946e7b5dbd1072faaf0e9 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311011b8f4bbb1a0e4ba2a0d32bdd132b6eee 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110134de8c5e4fbd48cfa1b02cbeb19d0355 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231101c6876a0a6c2c4090863461b8b0e80585 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311015b80085d4bd648f8bf44ba6fa51f67d3 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a102fc3388ac4ed794ad3c4264384eb1 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101a74af193b7134f9d8e10bab44166342b 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101e8e51e3b009e40799cf69cd49a2a9b7f 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110154a5476894a24713a741612ab2acdbf9 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311018fe37e12da4b48dda78840ca479aa938 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del 2023-11-01 09:55:47,658 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101b378a8901c9f473badda5377d50e9c82 2023-11-01 09:55:47,659 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231101d2590e2b556a4cf0a5a1a954aede55e7 2023-11-01 09:55:47,828 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:47,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:47,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:47,830 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-01 09:55:48,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-01 09:55:48,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:48,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:48,330 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:48,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:48,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-01 09:55:48,331 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-01 09:55:48,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698832535159-1698832547210 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:48,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698832535159-1698832547210 of table testCompactionWithHFileLink completed 2023-11-01 09:55:48,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:48,495 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:48,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698832535159-1698832547210 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698832547225Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698832547645 (+420 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698832535159-1698832547210 at 1698832548062 (+417 ms)Loading Region manifests for hbase-failsafe-snaptb-1698832535159-1698832547210 at 1698832548063 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1698832535159-1698832547210 at 1698832548069 (+6 ms)Verifying snapshot: hbase-failsafe-snaptb-1698832535159-1698832547210 at 1698832548476 (+407 ms)Snapshot hbase-failsafe-snaptb-1698832535159-1698832547210 of table testCompactionWithHFileLink completed at 1698832548494 (+18 ms) 2023-11-01 09:55:48,496 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-01 09:55:48,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2730 sec 2023-11-01 09:55:49,331 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-01 09:55:49,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-01 09:55:49,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698832535159-1698832547210 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-01 09:55:49,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698832535159" table: "testCompactionWithHFileLink" creation_time: 1698832535169 type: FLUSH version: 2 ttl: 0 ) 2023-11-01 09:55:49,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698832535159 as table=testCompactionWithHFileLink 2023-11-01 09:55:49,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-01 09:55:49,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-01 09:55:49,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-01 09:55:49,779 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-01 09:55:49,780 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-01 09:55:49,781 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-01 09:55:49,781 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-01 09:55:49,786 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698832535159" table: "testCompactionWithHFileLink" creation_time: 1698832535169 type: FLUSH version: 2 ttl: 0 2023-11-01 09:55:49,787 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink 2023-11-01 09:55:49,791 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-01 09:55:49,794 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311013535acecd81a4b6d9fd950bc33464206 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311013535acecd81a4b6d9fd950bc33464206 2023-11-01 09:55:49,795 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311018ee5663259a3473685e86b2b67f78c0f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311018ee5663259a3473685e86b2b67f78c0f 2023-11-01 09:55:49,796 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311012e0690408c3c4bbfbba9ee3e373b6d66 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311012e0690408c3c4bbfbba9ee3e373b6d66 2023-11-01 09:55:49,796 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,800 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,802 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,805 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,808 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,811 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,813 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,816 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,819 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,823 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,825 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,828 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 of snapshot=snaptb-1698832535159 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-01 09:55:49,833 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110173a5ab908fdd40bbb8ce00b5e3fdceb0_del 2023-11-01 09:55:49,834 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311019834e776cd264739a37932c755beb171_del 2023-11-01 09:55:49,835 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231101f9b9bb32d42c4e61b923255283feba38_del 2023-11-01 09:55:49,835 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:49,835 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:49,835 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:49,838 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/57fcef306ad14a9092a5d51f81ec9792_SeqId_29_ 2023-11-01 09:55:49,838 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/79f5d45f4d6341a58b1f0121bbe62efc_SeqId_29_ 2023-11-01 09:55:49,839 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/0b81a08b59c74220a2621d8e25b18416 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/0b81a08b59c74220a2621d8e25b18416 2023-11-01 09:55:49,840 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/577b785541584d8d889ad1e049a0b469 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/577b785541584d8d889ad1e049a0b469 2023-11-01 09:55:49,840 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8aff520de3e741289910198c4ddd903b of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,840 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/98eefac7cf344b78aec7cdb364c6d9ab to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/98eefac7cf344b78aec7cdb364c6d9ab 2023-11-01 09:55:49,840 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7601c27a248446958d3a299270c4996a of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,840 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/73dfd575c07b45629843173e56b2dde9_SeqId_29_ 2023-11-01 09:55:49,840 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 172b5f58fc4a4029b6a3e2e461d76e01 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,845 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6d278ec4dced4875944605ef9f4e71b2 of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,845 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d22883ff100a48f69750fe727d52bd00 of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,845 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 60f127267cb84b3abdac93e8ed4580d8 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,848 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6377f30930bf4bcfa1c08a32188dbbc3 of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,849 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7292657da0a14b58a5f62f607c555d84 of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,849 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 81b0d40e0caf43a59ef82de90f34f8cc of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,852 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f6ac77defa81451ab1d1ea9af78eb951 of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,852 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bf310a25a52a4b70a410eaf670380667 of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,853 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a804db85f34a4518b01f694d61cfab44 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,857 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/92a241d917ec49aab7d0eef2e4c9742e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/92a241d917ec49aab7d0eef2e4c9742e 2023-11-01 09:55:49,858 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 55607dfd0f954410a7929868c1f853ed of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,858 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/5125c8cfa17149a9936dc848587f0d50 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/5125c8cfa17149a9936dc848587f0d50 2023-11-01 09:55:49,858 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ca4e2695fea44ef896f32344bb250d2 of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,859 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a1fed3028b6a4a5f9109593b790cddb4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/a1fed3028b6a4a5f9109593b790cddb4 2023-11-01 09:55:49,859 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 968dc0f7a48f4cab98e19e18ed3f7314 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,869 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7794c8d2551a4ca6aeb54eb95707a974 of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,875 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8241cd158fc04d3a9f40e8dbee7c788a of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,875 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e41db25d8a694608926daf528d086cd9 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,876 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 14e788f410dc491bbf218b7206498dc0 of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,879 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ac0295f43174431695fb0478ed854ffa of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,879 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a9ffd6dfed5b472fa56c7c9878745b14 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,880 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c9ccbf67c6149a1a2a451275ab8717c of snapshot=snaptb-1698832535159 to region=6f8f2e3d3c925badce7580bd7572b250 table=testCompactionWithHFileLink 2023-11-01 09:55:49,882 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 302207e3f8f142529ca88f4c50c28ad3 of snapshot=snaptb-1698832535159 to region=a1270fae216de4a507f8780689d9bb05 table=testCompactionWithHFileLink 2023-11-01 09:55:49,883 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink da034b9476e64023ac3a013266aed2b0 of snapshot=snaptb-1698832535159 to region=ce95d44a8b3e79de7f5aab9d535373ee table=testCompactionWithHFileLink 2023-11-01 09:55:49,886 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698832535159" table: "testCompactionWithHFileLink" creation_time: 1698832535169 type: FLUSH version: 2 ttl: 0 2023-11-01 09:55:49,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698832549887"}]},"ts":"9223372036854775807"} 2023-11-01 09:55:49,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698832549887"}]},"ts":"9223372036854775807"} 2023-11-01 09:55:49,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698832549887"}]},"ts":"9223372036854775807"} 2023-11-01 09:55:49,889 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-01 09:55:49,889 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6f8f2e3d3c925badce7580bd7572b250, NAME => 'testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => a1270fae216de4a507f8780689d9bb05, NAME => 'testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => ce95d44a8b3e79de7f5aab9d535373ee, NAME => 'testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.', STARTKEY => '', ENDKEY => '1'}] 2023-11-01 09:55:49,889 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832549888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832549888"}]},"ts":"1698832549888"} 2023-11-01 09:55:49,889 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832549888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832549888"}]},"ts":"1698832549888"} 2023-11-01 09:55:49,889 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832549888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832549888"}]},"ts":"1698832549888"} 2023-11-01 09:55:49,890 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-01 09:55:49,890 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-01 09:55:49,891 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 6f8f2e3d3c925badce7580bd7572b250, NAME => 'testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => a1270fae216de4a507f8780689d9bb05, NAME => 'testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => ce95d44a8b3e79de7f5aab9d535373ee, NAME => 'testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.', STARTKEY => '', ENDKEY => '1'}] 2023-11-01 09:55:49,891 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698832535159 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-01 09:55:49,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698832535159" table: "testCompactionWithHFileLink" creation_time: 1698832535169 type: FLUSH version: 2 ttl: 0 ) in 531 msec 2023-11-01 09:55:49,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-01 09:55:49,976 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-01 09:55:49,976 INFO [Listener at localhost/37085] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:49,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1698832535159-1698832547210" 2023-11-01 09:55:49,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698832535159-1698832547210 2023-11-01 09:55:49,984 INFO [Listener at localhost/37085] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-01 09:55:49,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-01 09:55:49,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-01 09:55:49,995 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-01 09:55:49,995 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832549995"}]},"ts":"1698832549995"} 2023-11-01 09:55:49,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-01 09:55:49,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-01 09:55:49,998 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-01 09:55:49,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN}] 2023-11-01 09:55:50,000 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN 2023-11-01 09:55:50,000 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN 2023-11-01 09:55:50,000 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN 2023-11-01 09:55:50,000 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-01 09:55:50,000 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-01 09:55:50,000 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-01 09:55:50,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-01 09:55:50,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6f8f2e3d3c925badce7580bd7572b250, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a1270fae216de4a507f8780689d9bb05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,152 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=ce95d44a8b3e79de7f5aab9d535373ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832550152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832550152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832550152"}]},"ts":"1698832550152"} 2023-11-01 09:55:50,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832550152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832550152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832550152"}]},"ts":"1698832550152"} 2023-11-01 09:55:50,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832550152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832550152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832550152"}]},"ts":"1698832550152"} 2023-11-01 09:55:50,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:50,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:50,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:50,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-01 09:55:50,305 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:50,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1270fae216de4a507f8780689d9bb05, NAME => 'testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.', STARTKEY => '2', ENDKEY => ''} 2023-11-01 09:55:50,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:50,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,309 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,310 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:50,310 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:50,310 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1270fae216de4a507f8780689d9bb05 columnFamilyName family1 2023-11-01 09:55:50,320 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6377f30930bf4bcfa1c08a32188dbbc3 2023-11-01 09:55:50,325 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6d278ec4dced4875944605ef9f4e71b2 2023-11-01 09:55:50,330 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8aff520de3e741289910198c4ddd903b 2023-11-01 09:55:50,335 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-f6ac77defa81451ab1d1ea9af78eb951 2023-11-01 09:55:50,335 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(310): Store=a1270fae216de4a507f8780689d9bb05/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:50,335 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,336 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2 2023-11-01 09:55:50,336 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2 2023-11-01 09:55:50,336 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1270fae216de4a507f8780689d9bb05 columnFamilyName family2 2023-11-01 09:55:50,343 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-302207e3f8f142529ca88f4c50c28ad3 2023-11-01 09:55:50,348 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6ca4e2695fea44ef896f32344bb250d2 2023-11-01 09:55:50,352 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8241cd158fc04d3a9f40e8dbee7c788a 2023-11-01 09:55:50,357 DEBUG [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-ac0295f43174431695fb0478ed854ffa 2023-11-01 09:55:50,357 INFO [StoreOpener-a1270fae216de4a507f8780689d9bb05-1] regionserver.HStore(310): Store=a1270fae216de4a507f8780689d9bb05/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:50,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:55:50,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1270fae216de4a507f8780689d9bb05; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66381896, jitterRate=-0.010832667350769043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:50,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05., pid=101, masterSystemTime=1698832550305 2023-11-01 09:55:50,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:50,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:50,363 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-01 09:55:50,363 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-01 09:55:50,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:50,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:50,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:50,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce95d44a8b3e79de7f5aab9d535373ee, NAME => 'testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.', STARTKEY => '', ENDKEY => '1'} 2023-11-01 09:55:50,365 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a1270fae216de4a507f8780689d9bb05, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,366 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832550365"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832550365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832550365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832550365"}]},"ts":"1698832550365"} 2023-11-01 09:55:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,368 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-01 09:55:50,368 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1912): a1270fae216de4a507f8780689d9bb05/family2 is initiating minor compaction (all files) 2023-11-01 09:55:50,368 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a1270fae216de4a507f8780689d9bb05/family2 in testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:50,368 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6ca4e2695fea44ef896f32344bb250d2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8241cd158fc04d3a9f40e8dbee7c788a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-ac0295f43174431695fb0478ed854ffa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-302207e3f8f142529ca88f4c50c28ad3] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp, totalSize=20.4 K 2023-11-01 09:55:50,369 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6ca4e2695fea44ef896f32344bb250d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527984 2023-11-01 09:55:50,370 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8241cd158fc04d3a9f40e8dbee7c788a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:50,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-11-01 09:55:50,370 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure a1270fae216de4a507f8780689d9bb05, server=jenkins-hbase4.apache.org,40233,1698832432817 in 214 msec 2023-11-01 09:55:50,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a1270fae216de4a507f8780689d9bb05, ASSIGN in 373 msec 2023-11-01 09:55:50,372 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-ac0295f43174431695fb0478ed854ffa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:50,372 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-01 09:55:50,372 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:50,372 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1912): a1270fae216de4a507f8780689d9bb05/family1 is initiating minor compaction (all files) 2023-11-01 09:55:50,372 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:50,372 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a1270fae216de4a507f8780689d9bb05/family1 in testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:55:50,373 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8aff520de3e741289910198c4ddd903b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6d278ec4dced4875944605ef9f4e71b2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6377f30930bf4bcfa1c08a32188dbbc3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-f6ac77defa81451ab1d1ea9af78eb951] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp, totalSize=21.6 K 2023-11-01 09:55:50,373 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-302207e3f8f142529ca88f4c50c28ad3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:50,373 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce95d44a8b3e79de7f5aab9d535373ee columnFamilyName family1 2023-11-01 09:55:50,374 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8aff520de3e741289910198c4ddd903b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527984 2023-11-01 09:55:50,375 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6d278ec4dced4875944605ef9f4e71b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:50,378 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6377f30930bf4bcfa1c08a32188dbbc3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:50,382 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-f6ac77defa81451ab1d1ea9af78eb951, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:50,398 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-172b5f58fc4a4029b6a3e2e461d76e01 2023-11-01 09:55:50,408 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-60f127267cb84b3abdac93e8ed4580d8 2023-11-01 09:55:50,427 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] throttle.PressureAwareThroughputController(145): a1270fae216de4a507f8780689d9bb05#family2#compaction#114 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:50,429 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-81b0d40e0caf43a59ef82de90f34f8cc 2023-11-01 09:55:50,441 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): a1270fae216de4a507f8780689d9bb05#family1#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:50,444 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a804db85f34a4518b01f694d61cfab44 2023-11-01 09:55:50,445 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(310): Store=ce95d44a8b3e79de7f5aab9d535373ee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:50,445 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,446 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2 2023-11-01 09:55:50,446 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2 2023-11-01 09:55:50,446 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce95d44a8b3e79de7f5aab9d535373ee columnFamilyName family2 2023-11-01 09:55:50,458 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-968dc0f7a48f4cab98e19e18ed3f7314 2023-11-01 09:55:50,463 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a9ffd6dfed5b472fa56c7c9878745b14 2023-11-01 09:55:50,469 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-da034b9476e64023ac3a013266aed2b0 2023-11-01 09:55:50,475 DEBUG [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-e41db25d8a694608926daf528d086cd9 2023-11-01 09:55:50,475 INFO [StoreOpener-ce95d44a8b3e79de7f5aab9d535373ee-1] regionserver.HStore(310): Store=ce95d44a8b3e79de7f5aab9d535373ee/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:50,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:50,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:55:50,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce95d44a8b3e79de7f5aab9d535373ee; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65135670, jitterRate=-0.029402881860733032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:50,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:50,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee., pid=103, masterSystemTime=1698832550305 2023-11-01 09:55:50,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-01 09:55:50,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-01 09:55:50,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:50,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:50,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:50,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f8f2e3d3c925badce7580bd7572b250, NAME => 'testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.', STARTKEY => '1', ENDKEY => '2'} 2023-11-01 09:55:50,483 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=ce95d44a8b3e79de7f5aab9d535373ee, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:50,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698832550483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832550483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832550483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832550483"}]},"ts":"1698832550483"} 2023-11-01 09:55:50,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,485 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,486 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:50,486 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:50,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-11-01 09:55:50,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure ce95d44a8b3e79de7f5aab9d535373ee, server=jenkins-hbase4.apache.org,40233,1698832432817 in 329 msec 2023-11-01 09:55:50,486 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f8f2e3d3c925badce7580bd7572b250 columnFamilyName family1 2023-11-01 09:55:50,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ce95d44a8b3e79de7f5aab9d535373ee, ASSIGN in 488 msec 2023-11-01 09:55:50,495 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7292657da0a14b58a5f62f607c555d84 2023-11-01 09:55:50,500 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7601c27a248446958d3a299270c4996a 2023-11-01 09:55:50,508 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-bf310a25a52a4b70a410eaf670380667 2023-11-01 09:55:50,514 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-d22883ff100a48f69750fe727d52bd00 2023-11-01 09:55:50,514 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(310): Store=6f8f2e3d3c925badce7580bd7572b250/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:50,514 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,515 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2 2023-11-01 09:55:50,515 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2 2023-11-01 09:55:50,515 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f8f2e3d3c925badce7580bd7572b250 columnFamilyName family2 2023-11-01 09:55:50,523 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-14e788f410dc491bbf218b7206498dc0 2023-11-01 09:55:50,528 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-55607dfd0f954410a7929868c1f853ed 2023-11-01 09:55:50,540 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-6c9ccbf67c6149a1a2a451275ab8717c 2023-11-01 09:55:50,548 DEBUG [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(539): loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7794c8d2551a4ca6aeb54eb95707a974 2023-11-01 09:55:50,548 INFO [StoreOpener-6f8f2e3d3c925badce7580bd7572b250-1] regionserver.HStore(310): Store=6f8f2e3d3c925badce7580bd7572b250/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:50,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:55:50,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f8f2e3d3c925badce7580bd7572b250; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61379873, jitterRate=-0.08536861836910248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:50,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:50,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250., pid=102, masterSystemTime=1698832550305 2023-11-01 09:55:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-01 09:55:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-01 09:55:50,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:50,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:50,560 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6f8f2e3d3c925badce7580bd7572b250, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:50,560 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832550560"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832550560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832550560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832550560"}]},"ts":"1698832550560"} 2023-11-01 09:55:50,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-11-01 09:55:50,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 6f8f2e3d3c925badce7580bd7572b250, server=jenkins-hbase4.apache.org,40233,1698832432817 in 407 msec 2023-11-01 09:55:50,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-11-01 09:55:50,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6f8f2e3d3c925badce7580bd7572b250, ASSIGN in 565 msec 2023-11-01 09:55:50,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832550564"}]},"ts":"1698832550564"} 2023-11-01 09:55:50,565 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-01 09:55:50,567 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-01 09:55:50,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 578 msec 2023-11-01 09:55:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-01 09:55:50,598 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-01 09:55:50,621 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:50,632 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:50,643 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:50,643 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:50,650 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-01 09:55:50,672 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-01 09:55:50,672 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:50,673 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(139): Connect 0x3d29c2b9 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:55:50,679 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@270869c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:55:50,679 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:50,679 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:50,679 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:50,768 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110193e24505d2864401aec0e5c53bf258a4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110193e24505d2864401aec0e5c53bf258a4 2023-11-01 09:55:50,769 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:50,781 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:55:50,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:55:50,793 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:55:50,799 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:55:50,812 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/4018a280d9a54b7a9d4da675bb99a804 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-01 09:55:50,813 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=32 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/4018a280d9a54b7a9d4da675bb99a804}] 2023-11-01 09:55:50,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/4018a280d9a54b7a9d4da675bb99a804 for inclusion in ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:50,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-01 09:55:50,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last=1 2023-11-01 09:55:50,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:50,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101/family1/4018a280d9a54b7a9d4da675bb99a804 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__6u5frjdtk0p358nmbp2co7tlg3dg84qk9nbnts76p2nc9gr7nhiajibur8qsttgo/family1/4018a280d9a54b7a9d4da675bb99a804 2023-11-01 09:55:50,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__6u5frjdtk0p358nmbp2co7tlg3dg84qk9nbnts76p2nc9gr7nhiajibur8qsttgo/family1/4018a280d9a54b7a9d4da675bb99a804 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_ 2023-11-01 09:55:50,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__6u5frjdtk0p358nmbp2co7tlg3dg84qk9nbnts76p2nc9gr7nhiajibur8qsttgo/family1/4018a280d9a54b7a9d4da675bb99a804 into ce95d44a8b3e79de7f5aab9d535373ee/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_ - updating store file list. 2023-11-01 09:55:50,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_ into ce95d44a8b3e79de7f5aab9d535373ee/family1 2023-11-01 09:55:50,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__6u5frjdtk0p358nmbp2co7tlg3dg84qk9nbnts76p2nc9gr7nhiajibur8qsttgo/family1/4018a280d9a54b7a9d4da675bb99a804 into ce95d44a8b3e79de7f5aab9d535373ee/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_) 2023-11-01 09:55:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__6u5frjdtk0p358nmbp2co7tlg3dg84qk9nbnts76p2nc9gr7nhiajibur8qsttgo/family1/4018a280d9a54b7a9d4da675bb99a804 2023-11-01 09:55:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-01 09:55:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(1912): ce95d44a8b3e79de7f5aab9d535373ee/family1 is initiating minor compaction (all files) 2023-11-01 09:55:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@e124e5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-01 09:55:50,829 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:50,829 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:50,830 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311016b369e3c2d4844a3aacef2fd505bbedc 2023-11-01 09:55:50,831 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311017668406987fd435e94616fd2393f255a 2023-11-01 09:55:50,832 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311017e8d7a61c0d04941b41258c17e8e0b29 2023-11-01 09:55:50,832 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231101d7f1019c5eb14039a359999ad79a02a6 2023-11-01 09:55:50,833 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-01 09:55:50,833 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231101' 2023-11-01 09:55:50,833 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:51,562 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110188ba8fd2e3904c339c24b235161c5cc6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110188ba8fd2e3904c339c24b235161c5cc6 2023-11-01 09:55:51,562 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311016e59e407229b4d4da3b62bf2e702a903 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311016e59e407229b4d4da3b62bf2e702a903 2023-11-01 09:55:51,563 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:51,563 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:51,588 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-01 09:55:51,589 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b}] 2023-11-01 09:55:51,589 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/c0f9a443346e47709d77d2b39c1fa178 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-01 09:55:51,590 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/c0f9a443346e47709d77d2b39c1fa178}] 2023-11-01 09:55:51,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b for inclusion in a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:51,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/c0f9a443346e47709d77d2b39c1fa178 for inclusion in 6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-01 09:55:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-01 09:55:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-01 09:55:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-01 09:55:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:51,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101/family1/c0f9a443346e47709d77d2b39c1fa178 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__c49ji8hurtbm0o983h57f43lhkv2iiqjlnrj0q9muj30271mcqdojtg180lqj0js/family1/c0f9a443346e47709d77d2b39c1fa178 2023-11-01 09:55:51,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__8s0uipp9i118q5fpskiosvv404vs2en7h9tgrtrbtsish81o35ec96k0qr0hr67q/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b 2023-11-01 09:55:51,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__c49ji8hurtbm0o983h57f43lhkv2iiqjlnrj0q9muj30271mcqdojtg180lqj0js/family1/c0f9a443346e47709d77d2b39c1fa178 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_ 2023-11-01 09:55:51,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__c49ji8hurtbm0o983h57f43lhkv2iiqjlnrj0q9muj30271mcqdojtg180lqj0js/family1/c0f9a443346e47709d77d2b39c1fa178 into 6f8f2e3d3c925badce7580bd7572b250/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_ - updating store file list. 2023-11-01 09:55:51,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__8s0uipp9i118q5fpskiosvv404vs2en7h9tgrtrbtsish81o35ec96k0qr0hr67q/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/d7e91ea395eb4a829d7cb093185bd123_SeqId_34_ 2023-11-01 09:55:51,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__8s0uipp9i118q5fpskiosvv404vs2en7h9tgrtrbtsish81o35ec96k0qr0hr67q/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b into a1270fae216de4a507f8780689d9bb05/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/d7e91ea395eb4a829d7cb093185bd123_SeqId_34_ - updating store file list. 2023-11-01 09:55:51,601 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_ into 6f8f2e3d3c925badce7580bd7572b250/family1 2023-11-01 09:55:51,601 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__c49ji8hurtbm0o983h57f43lhkv2iiqjlnrj0q9muj30271mcqdojtg180lqj0js/family1/c0f9a443346e47709d77d2b39c1fa178 into 6f8f2e3d3c925badce7580bd7572b250/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_) 2023-11-01 09:55:51,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/d7e91ea395eb4a829d7cb093185bd123_SeqId_34_ into a1270fae216de4a507f8780689d9bb05/family1 2023-11-01 09:55:51,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__8s0uipp9i118q5fpskiosvv404vs2en7h9tgrtrbtsish81o35ec96k0qr0hr67q/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b into a1270fae216de4a507f8780689d9bb05/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/d7e91ea395eb4a829d7cb093185bd123_SeqId_34_) 2023-11-01 09:55:51,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__c49ji8hurtbm0o983h57f43lhkv2iiqjlnrj0q9muj30271mcqdojtg180lqj0js/family1/c0f9a443346e47709d77d2b39c1fa178 2023-11-01 09:55:51,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:55:51,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testCompactionWithHFileLink__8s0uipp9i118q5fpskiosvv404vs2en7h9tgrtrbtsish81o35ec96k0qr0hr67q/family1/6cd22d5c2c2c4118a8dd0cab118e0f0b 2023-11-01 09:55:51,604 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:51,604 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:51,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-01 09:55:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(1912): 6f8f2e3d3c925badce7580bd7572b250/family1 is initiating minor compaction (all files) 2023-11-01 09:55:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2e6434b3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-01 09:55:51,605 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101383fabf7b4b54e84b2254dca195a76ba 2023-11-01 09:55:51,606 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:51,607 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101c6d1e5cb02504b4380f2f961e0f30651 2023-11-01 09:55:51,607 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:51,608 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101e1b275ac0b574b3f860e7a13def2c791 2023-11-01 09:55:51,609 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101107db1f0d4fb4cceb5f43bc994e4dd7a 2023-11-01 09:55:51,609 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231101e9c390ae16764a179c354afeb7c1eea4 2023-11-01 09:55:51,609 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-01 09:55:51,609 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231101' 2023-11-01 09:55:51,609 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:51,610 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101183d0fac48214df9b8755ab66582ac6d 2023-11-01 09:55:51,611 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101e92dc6299746417d94fb7433a206a7eb 2023-11-01 09:55:51,612 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231101fcd16dba14204c93a31d4d69da6151ea 2023-11-01 09:55:51,612 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-01 09:55:51,612 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231101' 2023-11-01 09:55:51,612 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231101 for table='testCompactionWithHFileLink' and column='family1' 2023-11-01 09:55:51,612 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-01 09:55:51,615 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:51,616 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:51,619 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:51,620 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:51,626 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:55:51,627 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:55:51,643 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=287 (was 255) - Thread LEAK? -, OpenFileDescriptor=762 (was 640) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 189), ProcessCount=172 (was 172), AvailableMemoryMB=10491 (was 10557) 2023-11-01 09:55:51,650 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family2/db580355368d4d628126a8a57e2310aa as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/db580355368d4d628126a8a57e2310aa 2023-11-01 09:55:51,654 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-01 09:55:51,654 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=287, OpenFileDescriptor=762, MaxFileDescriptor=60000, SystemLoadAverage=139, ProcessCount=172, AvailableMemoryMB=10490 2023-11-01 09:55:51,654 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a1270fae216de4a507f8780689d9bb05/family2 of a1270fae216de4a507f8780689d9bb05 into db580355368d4d628126a8a57e2310aa(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:51,655 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:51,655 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05., storeName=a1270fae216de4a507f8780689d9bb05/family2, priority=12, startTime=1698832550363; duration=1sec 2023-11-01 09:55:51,655 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-01 09:55:51,655 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ce95d44a8b3e79de7f5aab9d535373ee/family1 in testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:51,655 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-172b5f58fc4a4029b6a3e2e461d76e01, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-60f127267cb84b3abdac93e8ed4580d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-81b0d40e0caf43a59ef82de90f34f8cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a804db85f34a4518b01f694d61cfab44, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp, totalSize=28.9 K 2023-11-01 09:55:51,656 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-172b5f58fc4a4029b6a3e2e461d76e01, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527982 2023-11-01 09:55:51,657 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-60f127267cb84b3abdac93e8ed4580d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529784 2023-11-01 09:55:51,657 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-81b0d40e0caf43a59ef82de90f34f8cc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:51,658 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a804db85f34a4518b01f694d61cfab44, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533376 2023-11-01 09:55:51,658 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting 7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698832527982 2023-11-01 09:55:51,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-01 09:55:51,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-01 09:55:51,663 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/.tmp/family1/a1add6fbfe5c4d0d968bdaf11d251e8d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/a1add6fbfe5c4d0d968bdaf11d251e8d 2023-11-01 09:55:51,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-01 09:55:51,668 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a1270fae216de4a507f8780689d9bb05/family1 of a1270fae216de4a507f8780689d9bb05 into a1add6fbfe5c4d0d968bdaf11d251e8d(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:51,668 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:55:51,668 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05., storeName=a1270fae216de4a507f8780689d9bb05/family1, priority=12, startTime=1698832550363; duration=1sec 2023-11-01 09:55:51,668 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-01 09:55:51,668 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-01 09:55:51,668 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6f8f2e3d3c925badce7580bd7572b250/family1 in testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:51,668 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7601c27a248446958d3a299270c4996a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-d22883ff100a48f69750fe727d52bd00, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7292657da0a14b58a5f62f607c555d84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-bf310a25a52a4b70a410eaf670380667, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp, totalSize=28.9 K 2023-11-01 09:55:51,669 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7601c27a248446958d3a299270c4996a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527983 2023-11-01 09:55:51,670 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-d22883ff100a48f69750fe727d52bd00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:51,670 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7292657da0a14b58a5f62f607c555d84, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:51,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 10 msec 2023-11-01 09:55:51,671 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-bf310a25a52a4b70a410eaf670380667, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:51,671 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698832527983 2023-11-01 09:55:51,674 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] throttle.PressureAwareThroughputController(145): ce95d44a8b3e79de7f5aab9d535373ee#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:51,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8aff520de3e741289910198c4ddd903b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6d278ec4dced4875944605ef9f4e71b2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6377f30930bf4bcfa1c08a32188dbbc3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-f6ac77defa81451ab1d1ea9af78eb951] to archive 2023-11-01 09:55:51,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:51,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8aff520de3e741289910198c4ddd903b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8aff520de3e741289910198c4ddd903b 2023-11-01 09:55:51,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6d278ec4dced4875944605ef9f4e71b2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6d278ec4dced4875944605ef9f4e71b2 2023-11-01 09:55:51,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6377f30930bf4bcfa1c08a32188dbbc3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6377f30930bf4bcfa1c08a32188dbbc3 2023-11-01 09:55:51,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-f6ac77defa81451ab1d1ea9af78eb951 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family1/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-f6ac77defa81451ab1d1ea9af78eb951 2023-11-01 09:55:51,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6ca4e2695fea44ef896f32344bb250d2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8241cd158fc04d3a9f40e8dbee7c788a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-ac0295f43174431695fb0478ed854ffa, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-302207e3f8f142529ca88f4c50c28ad3] to archive 2023-11-01 09:55:51,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:51,686 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6f8f2e3d3c925badce7580bd7572b250#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:51,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6ca4e2695fea44ef896f32344bb250d2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-6ca4e2695fea44ef896f32344bb250d2 2023-11-01 09:55:51,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8241cd158fc04d3a9f40e8dbee7c788a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-8241cd158fc04d3a9f40e8dbee7c788a 2023-11-01 09:55:51,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-ac0295f43174431695fb0478ed854ffa to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-ac0295f43174431695fb0478ed854ffa 2023-11-01 09:55:51,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-302207e3f8f142529ca88f4c50c28ad3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/family2/testCompactionWithHFileLink=a1270fae216de4a507f8780689d9bb05-302207e3f8f142529ca88f4c50c28ad3 2023-11-01 09:55:51,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-01 09:55:51,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-01 09:55:51,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-01 09:55:51,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:55:51,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-01 09:55:51,770 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:55:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-01 09:55:51,772 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:51,772 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:51,772 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f 2023-11-01 09:55:51,772 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1 empty. 2023-11-01 09:55:51,772 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f empty. 2023-11-01 09:55:51,772 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815 empty. 2023-11-01 09:55:51,773 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:51,773 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:51,773 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f 2023-11-01 09:55:51,773 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-01 09:55:51,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-01 09:55:52,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-01 09:55:52,090 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family1/dc7c954831f84135b64983d5e7a1d6b2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/dc7c954831f84135b64983d5e7a1d6b2 2023-11-01 09:55:52,097 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in ce95d44a8b3e79de7f5aab9d535373ee/family1 of ce95d44a8b3e79de7f5aab9d535373ee into dc7c954831f84135b64983d5e7a1d6b2(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:55:52,097 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:52,098 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698832550827; duration=0sec 2023-11-01 09:55:52,098 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-01 09:55:52,098 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-01 09:55:52,101 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family1/8dee31189de34a868fdea72c5ae8adb6 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/8dee31189de34a868fdea72c5ae8adb6 2023-11-01 09:55:52,101 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-01 09:55:52,101 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1912): ce95d44a8b3e79de7f5aab9d535373ee/family2 is initiating minor compaction (all files) 2023-11-01 09:55:52,101 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ce95d44a8b3e79de7f5aab9d535373ee/family2 in testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:55:52,101 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-968dc0f7a48f4cab98e19e18ed3f7314, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-e41db25d8a694608926daf528d086cd9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a9ffd6dfed5b472fa56c7c9878745b14, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-da034b9476e64023ac3a013266aed2b0] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp, totalSize=20.4 K 2023-11-01 09:55:52,102 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-968dc0f7a48f4cab98e19e18ed3f7314, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527982 2023-11-01 09:55:52,102 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-e41db25d8a694608926daf528d086cd9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529784 2023-11-01 09:55:52,103 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a9ffd6dfed5b472fa56c7c9878745b14, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:52,104 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-da034b9476e64023ac3a013266aed2b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533376 2023-11-01 09:55:52,105 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 6f8f2e3d3c925badce7580bd7572b250/family1 of 6f8f2e3d3c925badce7580bd7572b250 into 8dee31189de34a868fdea72c5ae8adb6(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:55:52,105 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:52,105 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698832551605; duration=0sec 2023-11-01 09:55:52,105 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-01 09:55:52,105 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-01 09:55:52,108 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-01 09:55:52,108 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1912): 6f8f2e3d3c925badce7580bd7572b250/family2 is initiating minor compaction (all files) 2023-11-01 09:55:52,108 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6f8f2e3d3c925badce7580bd7572b250/family2 in testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:55:52,108 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-55607dfd0f954410a7929868c1f853ed, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7794c8d2551a4ca6aeb54eb95707a974, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-14e788f410dc491bbf218b7206498dc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-6c9ccbf67c6149a1a2a451275ab8717c] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp, totalSize=20.4 K 2023-11-01 09:55:52,108 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-55607dfd0f954410a7929868c1f853ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832527983 2023-11-01 09:55:52,109 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7794c8d2551a4ca6aeb54eb95707a974, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832529785 2023-11-01 09:55:52,110 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-14e788f410dc491bbf218b7206498dc0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832531583 2023-11-01 09:55:52,110 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-6c9ccbf67c6149a1a2a451275ab8717c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832533377 2023-11-01 09:55:52,121 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] throttle.PressureAwareThroughputController(145): ce95d44a8b3e79de7f5aab9d535373ee#family2#compaction#118 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:52,123 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6f8f2e3d3c925badce7580bd7572b250#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 61.54 MB/second 2023-11-01 09:55:52,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7601c27a248446958d3a299270c4996a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-d22883ff100a48f69750fe727d52bd00, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7292657da0a14b58a5f62f607c555d84, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-bf310a25a52a4b70a410eaf670380667, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_] to archive 2023-11-01 09:55:52,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:52,179 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-01 09:55:52,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7601c27a248446958d3a299270c4996a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7601c27a248446958d3a299270c4996a 2023-11-01 09:55:52,181 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2e105341a2540afe949315054ef0502f, NAME => 'ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:52,181 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 46e683a163a0dbf6891bd67423ae4815, NAME => 'ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:52,181 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => cea8e1796b56252af8d44bbee2eec2a1, NAME => 'ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:55:52,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-d22883ff100a48f69750fe727d52bd00 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-d22883ff100a48f69750fe727d52bd00 2023-11-01 09:55:52,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7292657da0a14b58a5f62f607c555d84 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7292657da0a14b58a5f62f607c555d84 2023-11-01 09:55:52,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-bf310a25a52a4b70a410eaf670380667 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-bf310a25a52a4b70a410eaf670380667 2023-11-01 09:55:52,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family1/ac3f9fbba16d4fd8b8eb7ac27dff7142_SeqId_34_ 2023-11-01 09:55:52,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-172b5f58fc4a4029b6a3e2e461d76e01, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-60f127267cb84b3abdac93e8ed4580d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-81b0d40e0caf43a59ef82de90f34f8cc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a804db85f34a4518b01f694d61cfab44, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_] to archive 2023-11-01 09:55:52,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:52,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-172b5f58fc4a4029b6a3e2e461d76e01 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-172b5f58fc4a4029b6a3e2e461d76e01 2023-11-01 09:55:52,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-60f127267cb84b3abdac93e8ed4580d8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-60f127267cb84b3abdac93e8ed4580d8 2023-11-01 09:55:52,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-81b0d40e0caf43a59ef82de90f34f8cc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-81b0d40e0caf43a59ef82de90f34f8cc 2023-11-01 09:55:52,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a804db85f34a4518b01f694d61cfab44 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a804db85f34a4518b01f694d61cfab44 2023-11-01 09:55:52,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family1/7d765b0a0a7f4543bc40ebc463a18070_SeqId_34_ 2023-11-01 09:55:52,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 2e105341a2540afe949315054ef0502f, disabling compactions & flushes 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:52,592 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 46e683a163a0dbf6891bd67423ae4815, disabling compactions & flushes 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing cea8e1796b56252af8d44bbee2eec2a1, disabling compactions & flushes 2023-11-01 09:55:52,592 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,592 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. after waiting 0 ms 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. after waiting 0 ms 2023-11-01 09:55:52,592 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. after waiting 0 ms 2023-11-01 09:55:52,593 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,593 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,593 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,593 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:55:52,595 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:55:52,596 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698832552595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832552595"}]},"ts":"1698832552595"} 2023-11-01 09:55:52,596 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698832552595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832552595"}]},"ts":"1698832552595"} 2023-11-01 09:55:52,596 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698832552595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832552595"}]},"ts":"1698832552595"} 2023-11-01 09:55:52,597 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-01 09:55:52,598 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:55:52,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832552598"}]},"ts":"1698832552598"} 2023-11-01 09:55:52,599 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-01 09:55:52,601 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:55:52,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cea8e1796b56252af8d44bbee2eec2a1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e683a163a0dbf6891bd67423ae4815, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2e105341a2540afe949315054ef0502f, ASSIGN}] 2023-11-01 09:55:52,604 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e683a163a0dbf6891bd67423ae4815, ASSIGN 2023-11-01 09:55:52,604 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2e105341a2540afe949315054ef0502f, ASSIGN 2023-11-01 09:55:52,604 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cea8e1796b56252af8d44bbee2eec2a1, ASSIGN 2023-11-01 09:55:52,604 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e683a163a0dbf6891bd67423ae4815, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:52,604 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2e105341a2540afe949315054ef0502f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:52,604 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cea8e1796b56252af8d44bbee2eec2a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:55:52,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=46e683a163a0dbf6891bd67423ae4815, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,757 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cea8e1796b56252af8d44bbee2eec2a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=2e105341a2540afe949315054ef0502f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698832552757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832552757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832552757"}]},"ts":"1698832552757"} 2023-11-01 09:55:52,757 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698832552757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832552757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832552757"}]},"ts":"1698832552757"} 2023-11-01 09:55:52,757 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698832552757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832552757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832552757"}]},"ts":"1698832552757"} 2023-11-01 09:55:52,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 46e683a163a0dbf6891bd67423ae4815, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:52,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 2e105341a2540afe949315054ef0502f, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:52,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure cea8e1796b56252af8d44bbee2eec2a1, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:55:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-01 09:55:52,910 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cea8e1796b56252af8d44bbee2eec2a1, NAME => 'ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.', STARTKEY => '', ENDKEY => '1'} 2023-11-01 09:55:52,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:52,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,914 INFO [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,916 DEBUG [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1 2023-11-01 09:55:52,916 DEBUG [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1 2023-11-01 09:55:52,916 INFO [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cea8e1796b56252af8d44bbee2eec2a1 columnFamilyName family1 2023-11-01 09:55:52,917 INFO [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] regionserver.HStore(310): Store=cea8e1796b56252af8d44bbee2eec2a1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:52,918 INFO [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,919 DEBUG [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2 2023-11-01 09:55:52,919 DEBUG [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2 2023-11-01 09:55:52,919 INFO [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cea8e1796b56252af8d44bbee2eec2a1 columnFamilyName family2 2023-11-01 09:55:52,920 INFO [StoreOpener-cea8e1796b56252af8d44bbee2eec2a1-1] regionserver.HStore(310): Store=cea8e1796b56252af8d44bbee2eec2a1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:52,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:52,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:55:52,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:52,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cea8e1796b56252af8d44bbee2eec2a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73753896, jitterRate=0.09901869297027588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:52,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:55:52,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1., pid=111, masterSystemTime=1698832552910 2023-11-01 09:55:52,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:52,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e105341a2540afe949315054ef0502f, NAME => 'ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.', STARTKEY => '2', ENDKEY => ''} 2023-11-01 09:55:52,928 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cea8e1796b56252af8d44bbee2eec2a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,928 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698832552928"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832552928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832552928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832552928"}]},"ts":"1698832552928"} 2023-11-01 09:55:52,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:52,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,930 INFO [StoreOpener-2e105341a2540afe949315054ef0502f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-01 09:55:52,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure cea8e1796b56252af8d44bbee2eec2a1, server=jenkins-hbase4.apache.org,40233,1698832432817 in 170 msec 2023-11-01 09:55:52,931 DEBUG [StoreOpener-2e105341a2540afe949315054ef0502f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1 2023-11-01 09:55:52,931 DEBUG [StoreOpener-2e105341a2540afe949315054ef0502f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1 2023-11-01 09:55:52,931 INFO [StoreOpener-2e105341a2540afe949315054ef0502f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e105341a2540afe949315054ef0502f columnFamilyName family1 2023-11-01 09:55:52,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=cea8e1796b56252af8d44bbee2eec2a1, ASSIGN in 330 msec 2023-11-01 09:55:52,932 INFO [StoreOpener-2e105341a2540afe949315054ef0502f-1] regionserver.HStore(310): Store=2e105341a2540afe949315054ef0502f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:52,932 INFO [StoreOpener-2e105341a2540afe949315054ef0502f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,933 DEBUG [StoreOpener-2e105341a2540afe949315054ef0502f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2 2023-11-01 09:55:52,933 DEBUG [StoreOpener-2e105341a2540afe949315054ef0502f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2 2023-11-01 09:55:52,933 INFO [StoreOpener-2e105341a2540afe949315054ef0502f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e105341a2540afe949315054ef0502f columnFamilyName family2 2023-11-01 09:55:52,934 INFO [StoreOpener-2e105341a2540afe949315054ef0502f-1] regionserver.HStore(310): Store=2e105341a2540afe949315054ef0502f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:52,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:52,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e105341a2540afe949315054ef0502f 2023-11-01 09:55:52,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:52,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e105341a2540afe949315054ef0502f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65965574, jitterRate=-0.017036348581314087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:52,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:55:52,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f., pid=110, masterSystemTime=1698832552910 2023-11-01 09:55:52,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:52,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46e683a163a0dbf6891bd67423ae4815, NAME => 'ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.', STARTKEY => '1', ENDKEY => '2'} 2023-11-01 09:55:52,940 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=2e105341a2540afe949315054ef0502f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,940 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698832552940"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832552940"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832552940"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832552940"}]},"ts":"1698832552940"} 2023-11-01 09:55:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:55:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,941 INFO [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,942 DEBUG [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1 2023-11-01 09:55:52,942 DEBUG [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1 2023-11-01 09:55:52,942 INFO [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46e683a163a0dbf6891bd67423ae4815 columnFamilyName family1 2023-11-01 09:55:52,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-11-01 09:55:52,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 2e105341a2540afe949315054ef0502f, server=jenkins-hbase4.apache.org,40233,1698832432817 in 182 msec 2023-11-01 09:55:52,943 INFO [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] regionserver.HStore(310): Store=46e683a163a0dbf6891bd67423ae4815/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:52,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2e105341a2540afe949315054ef0502f, ASSIGN in 341 msec 2023-11-01 09:55:52,943 INFO [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,944 DEBUG [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2 2023-11-01 09:55:52,944 DEBUG [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2 2023-11-01 09:55:52,944 INFO [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46e683a163a0dbf6891bd67423ae4815 columnFamilyName family2 2023-11-01 09:55:52,945 INFO [StoreOpener-46e683a163a0dbf6891bd67423ae4815-1] regionserver.HStore(310): Store=46e683a163a0dbf6891bd67423ae4815/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:55:52,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:55:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:55:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:55:52,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 46e683a163a0dbf6891bd67423ae4815; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67064634, jitterRate=-6.590783596038818E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:55:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:55:52,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815., pid=109, masterSystemTime=1698832552910 2023-11-01 09:55:52,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:52,951 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=46e683a163a0dbf6891bd67423ae4815, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:52,951 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698832552951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832552951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832552951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832552951"}]},"ts":"1698832552951"} 2023-11-01 09:55:52,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-01 09:55:52,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 46e683a163a0dbf6891bd67423ae4815, server=jenkins-hbase4.apache.org,40233,1698832432817 in 194 msec 2023-11-01 09:55:52,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-01 09:55:52,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=46e683a163a0dbf6891bd67423ae4815, ASSIGN in 352 msec 2023-11-01 09:55:52,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:55:52,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832552954"}]},"ts":"1698832552954"} 2023-11-01 09:55:52,955 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-01 09:55:52,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:55:52,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1900 sec 2023-11-01 09:55:52,969 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/.tmp/family2/9c91b099c4614c52ac12a151d07470fe as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/9c91b099c4614c52ac12a151d07470fe 2023-11-01 09:55:52,972 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ce95d44a8b3e79de7f5aab9d535373ee/family2 of ce95d44a8b3e79de7f5aab9d535373ee into 9c91b099c4614c52ac12a151d07470fe(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:55:52,972 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:55:52,972 INFO [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee., storeName=ce95d44a8b3e79de7f5aab9d535373ee/family2, priority=12, startTime=1698832550481; duration=0sec 2023-11-01 09:55:52,972 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-01 09:55:52,972 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. because compaction request was cancelled 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-01 09:55:52,973 DEBUG [RS:0;jenkins-hbase4:40233-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. because compaction request was cancelled 2023-11-01 09:55:52,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-968dc0f7a48f4cab98e19e18ed3f7314, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-e41db25d8a694608926daf528d086cd9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a9ffd6dfed5b472fa56c7c9878745b14, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-da034b9476e64023ac3a013266aed2b0] to archive 2023-11-01 09:55:52,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:52,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-968dc0f7a48f4cab98e19e18ed3f7314 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-968dc0f7a48f4cab98e19e18ed3f7314 2023-11-01 09:55:52,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-e41db25d8a694608926daf528d086cd9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-e41db25d8a694608926daf528d086cd9 2023-11-01 09:55:52,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a9ffd6dfed5b472fa56c7c9878745b14 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-a9ffd6dfed5b472fa56c7c9878745b14 2023-11-01 09:55:52,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-da034b9476e64023ac3a013266aed2b0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/family2/testCompactionWithHFileLink=ce95d44a8b3e79de7f5aab9d535373ee-da034b9476e64023ac3a013266aed2b0 2023-11-01 09:55:53,373 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/.tmp/family2/aec36834560848b79b49410c2d44f210 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/aec36834560848b79b49410c2d44f210 2023-11-01 09:55:53,377 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6f8f2e3d3c925badce7580bd7572b250/family2 of 6f8f2e3d3c925badce7580bd7572b250 into aec36834560848b79b49410c2d44f210(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:55:53,377 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:55:53,377 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250., storeName=6f8f2e3d3c925badce7580bd7572b250/family2, priority=12, startTime=1698832550558; duration=1sec 2023-11-01 09:55:53,377 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:55:53,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-55607dfd0f954410a7929868c1f853ed, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7794c8d2551a4ca6aeb54eb95707a974, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-14e788f410dc491bbf218b7206498dc0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-6c9ccbf67c6149a1a2a451275ab8717c] to archive 2023-11-01 09:55:53,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:55:53,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-55607dfd0f954410a7929868c1f853ed to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-55607dfd0f954410a7929868c1f853ed 2023-11-01 09:55:53,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7794c8d2551a4ca6aeb54eb95707a974 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-7794c8d2551a4ca6aeb54eb95707a974 2023-11-01 09:55:53,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-14e788f410dc491bbf218b7206498dc0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-14e788f410dc491bbf218b7206498dc0 2023-11-01 09:55:53,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-6c9ccbf67c6149a1a2a451275ab8717c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/family2/testCompactionWithHFileLink=6f8f2e3d3c925badce7580bd7572b250-6c9ccbf67c6149a1a2a451275ab8717c 2023-11-01 09:55:53,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-01 09:55:53,875 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-01 09:55:53,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:53,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:53,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:53,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:53,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-01 09:55:53,887 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-01 09:55:53,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:53,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-01 09:55:53,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-01 09:55:53,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:53,887 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:53,888 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:53,888 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:53,889 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:53,889 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:53,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:53,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:53,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:53,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:53,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-01 09:55:53,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-01 09:55:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-01 09:55:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-01 09:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:53,890 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. started... 2023-11-01 09:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. started... 2023-11-01 09:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. started... 2023-11-01 09:55:53,892 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46e683a163a0dbf6891bd67423ae4815 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:55:53,892 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cea8e1796b56252af8d44bbee2eec2a1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:55:53,892 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2e105341a2540afe949315054ef0502f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:55:54,134 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-11-01 09:55:54,304 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101cda6896868b64a428f17a8560088cb13 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231101cda6896868b64a428f17a8560088cb13 2023-11-01 09:55:54,304 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311010300819c9a3c44e9b0499817a7b6c098 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311010300819c9a3c44e9b0499817a7b6c098 2023-11-01 09:55:54,304 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101b4f0b8265b5549dba8c3089ee7f4dc2e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231101b4f0b8265b5549dba8c3089ee7f4dc2e 2023-11-01 09:55:54,518 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-01 09:55:54,708 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/318de5ed4a174461856c3dafcdc02c6e 2023-11-01 09:55:54,711 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/c4cc80f29047445bb269f3f3dc496259 2023-11-01 09:55:54,711 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/7faaf0fb33424ad3b39e42568c530055 2023-11-01 09:55:54,723 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311019d5b4a202d244239b3caaaa9cad6a202 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311019d5b4a202d244239b3caaaa9cad6a202 2023-11-01 09:55:55,125 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101ea6536a2686e4b6d930dfe632334cb22 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231101ea6536a2686e4b6d930dfe632334cb22 2023-11-01 09:55:55,125 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110133d28753505d42c0912797e89ae28115 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023110133d28753505d42c0912797e89ae28115 2023-11-01 09:55:55,127 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/a0f5a02fcc724c498947db0ee22cdbea 2023-11-01 09:55:55,131 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/318de5ed4a174461856c3dafcdc02c6e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/318de5ed4a174461856c3dafcdc02c6e 2023-11-01 09:55:55,134 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/318de5ed4a174461856c3dafcdc02c6e, entries=4, sequenceid=5, filesize=5.4 K 2023-11-01 09:55:55,135 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/a0f5a02fcc724c498947db0ee22cdbea as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/a0f5a02fcc724c498947db0ee22cdbea 2023-11-01 09:55:55,137 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/a0f5a02fcc724c498947db0ee22cdbea, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:55:55,138 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2e105341a2540afe949315054ef0502f in 1246ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:55,139 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:55:55,139 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:55,139 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:55,530 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/2955574d3e3a481980cddf8d06373414 2023-11-01 09:55:55,530 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/66c04b1f74804207bf276bf5b357e54c 2023-11-01 09:55:55,535 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/c4cc80f29047445bb269f3f3dc496259 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/c4cc80f29047445bb269f3f3dc496259 2023-11-01 09:55:55,536 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/7faaf0fb33424ad3b39e42568c530055 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/7faaf0fb33424ad3b39e42568c530055 2023-11-01 09:55:55,540 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/c4cc80f29047445bb269f3f3dc496259, entries=4, sequenceid=5, filesize=5.4 K 2023-11-01 09:55:55,540 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/7faaf0fb33424ad3b39e42568c530055, entries=4, sequenceid=5, filesize=5.4 K 2023-11-01 09:55:55,541 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/2955574d3e3a481980cddf8d06373414 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/2955574d3e3a481980cddf8d06373414 2023-11-01 09:55:55,541 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/66c04b1f74804207bf276bf5b357e54c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/66c04b1f74804207bf276bf5b357e54c 2023-11-01 09:55:55,544 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/2955574d3e3a481980cddf8d06373414, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:55:55,544 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/66c04b1f74804207bf276bf5b357e54c, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:55:55,545 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cea8e1796b56252af8d44bbee2eec2a1 in 1653ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:55,545 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 46e683a163a0dbf6891bd67423ae4815 in 1653ms, sequenceid=5, compaction requested=false 2023-11-01 09:55:55,545 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:55:55,545 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:55:55,545 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:55,545 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:55,545 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-01 09:55:55,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-01 09:55:55,547 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,547 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:55,547 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,548 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:55,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-01 09:55:55,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7103cd4c[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:55,549 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-01 09:55:55,549 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,550 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,550 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-01 09:55:55,550 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,550 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:55,550 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-01 09:55:55,550 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:55,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-01 09:55:55,552 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:55,552 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-01 09:55:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:55,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-01 09:55:55,555 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-01 09:55:55,556 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:55,556 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:55,556 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-01 09:55:55,556 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:55,558 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,558 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:55,558 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,559 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:55,560 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:55,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-01 09:55:55,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:55,563 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:55,563 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,564 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:55,564 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,664 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:55,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:55,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:55,666 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:55,666 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:55,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:55,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:55,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-01 09:55:55,671 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-01 09:55:55,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:55,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-01 09:55:55,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-01 09:55:55,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:55,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:55,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:55,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:55,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:55,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:55,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:55,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:55,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-01 09:55:55,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-01 09:55:55,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-01 09:55:55,675 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-01 09:55:55,675 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:55,675 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-01 09:55:55,675 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:55,675 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. started... 2023-11-01 09:55:55,675 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46e683a163a0dbf6891bd67423ae4815 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:55:55,685 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:55,685 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:55,685 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:55,685 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. started... 2023-11-01 09:55:55,685 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. started... 2023-11-01 09:55:55,685 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cea8e1796b56252af8d44bbee2eec2a1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:55:55,685 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2e105341a2540afe949315054ef0502f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:55:56,103 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101bd434f187445438589c1d4e783df350d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231101bd434f187445438589c1d4e783df350d 2023-11-01 09:55:56,115 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101bc3d01dbca55464390abe26302c1dd06 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231101bc3d01dbca55464390abe26302c1dd06 2023-11-01 09:55:56,115 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101d9e8ea48d90843efada3dfc4fb87a956 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231101d9e8ea48d90843efada3dfc4fb87a956 2023-11-01 09:55:56,130 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/7e31f91e70fb4715aebb269801be2757 2023-11-01 09:55:56,145 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101c94216c9f20e4bd4a5f9a0abfb988dc7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231101c94216c9f20e4bd4a5f9a0abfb988dc7 2023-11-01 09:55:56,149 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/cf7bf310bdf64912ae253a68495299a0 2023-11-01 09:55:56,152 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/7e31f91e70fb4715aebb269801be2757 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/7e31f91e70fb4715aebb269801be2757 2023-11-01 09:55:56,155 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/7e31f91e70fb4715aebb269801be2757, entries=4, sequenceid=9, filesize=5.4 K 2023-11-01 09:55:56,156 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/cf7bf310bdf64912ae253a68495299a0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf7bf310bdf64912ae253a68495299a0 2023-11-01 09:55:56,159 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf7bf310bdf64912ae253a68495299a0, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:55:56,159 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2e105341a2540afe949315054ef0502f in 474ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:56,159 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:55:56,160 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:56,160 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:56,513 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/eafd598b15ee439bba8b31b9ec602919 2023-11-01 09:55:56,524 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/953a314f8335458a8e64124e3a04a967 2023-11-01 09:55:56,943 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101aa3da0541f2446a1bb3074444238c098 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231101aa3da0541f2446a1bb3074444238c098 2023-11-01 09:55:56,947 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/6c3820f094654c01bbc34715eff34a40 2023-11-01 09:55:56,950 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311012997d4acd8584db19f3f94d0d596a405 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311012997d4acd8584db19f3f94d0d596a405 2023-11-01 09:55:56,951 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/eafd598b15ee439bba8b31b9ec602919 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/eafd598b15ee439bba8b31b9ec602919 2023-11-01 09:55:56,955 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/eafd598b15ee439bba8b31b9ec602919, entries=4, sequenceid=9, filesize=5.4 K 2023-11-01 09:55:56,955 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/6c3820f094654c01bbc34715eff34a40 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/6c3820f094654c01bbc34715eff34a40 2023-11-01 09:55:56,958 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/6c3820f094654c01bbc34715eff34a40, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:55:56,959 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 46e683a163a0dbf6891bd67423ae4815 in 1284ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:56,959 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:55:56,959 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:56,959 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:57,355 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/ec466eb5a52f46278944bfe7f5488686 2023-11-01 09:55:57,360 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/953a314f8335458a8e64124e3a04a967 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/953a314f8335458a8e64124e3a04a967 2023-11-01 09:55:57,364 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/953a314f8335458a8e64124e3a04a967, entries=4, sequenceid=9, filesize=5.4 K 2023-11-01 09:55:57,365 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/ec466eb5a52f46278944bfe7f5488686 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/ec466eb5a52f46278944bfe7f5488686 2023-11-01 09:55:57,369 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/ec466eb5a52f46278944bfe7f5488686, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:55:57,369 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cea8e1796b56252af8d44bbee2eec2a1 in 1684ms, sequenceid=9, compaction requested=false 2023-11-01 09:55:57,370 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:55:57,370 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-01 09:55:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-01 09:55:57,372 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,372 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:57,372 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,372 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:57,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-01 09:55:57,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5afcb61a[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:57,374 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-01 09:55:57,374 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,375 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,375 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-01 09:55:57,375 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-01 09:55:57,376 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:57,376 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,376 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:57,383 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,383 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-01 09:55:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:57,383 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:57,384 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-01 09:55:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:57,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-01 09:55:57,386 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-01 09:55:57,386 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:57,387 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:57,387 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-01 09:55:57,387 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:57,389 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,389 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:57,389 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:57,390 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:57,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:57,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:57,391 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:57,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:57,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,394 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:57,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:57,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:57,394 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:57,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-01 09:55:57,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:57,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-01 09:55:57,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:57,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:57,395 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:57,395 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:57,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:57,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:57,495 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:57,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:57,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:57,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:57,498 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:57,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:57,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:57,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-01 09:55:57,503 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-01 09:55:57,503 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:57,503 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-01 09:55:57,504 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-01 09:55:57,504 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,504 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:57,506 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,506 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:57,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:57,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:57,506 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:57,506 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:57,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:57,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:57,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:57,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:57,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-01 09:55:57,507 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-01 09:55:57,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-01 09:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-01 09:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-01 09:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. started... 2023-11-01 09:55:57,508 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46e683a163a0dbf6891bd67423ae4815 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. started... 2023-11-01 09:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:57,508 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:57,509 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:57,508 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. started... 2023-11-01 09:55:57,509 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cea8e1796b56252af8d44bbee2eec2a1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:55:57,508 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2e105341a2540afe949315054ef0502f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:55:57,529 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101cf635d41be8f4abda7a60eda84e37359 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231101cf635d41be8f4abda7a60eda84e37359 2023-11-01 09:55:57,534 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101280333733f074eb8bb0218776b07fcc3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231101280333733f074eb8bb0218776b07fcc3 2023-11-01 09:55:57,534 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/74d6b40a07134ecd84e8bde812feb4cb 2023-11-01 09:55:57,547 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/5c280c7ea8034b87811f4b42af1b7446 2023-11-01 09:55:57,565 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101a504b2c41a454621b522735458bfa209 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231101a504b2c41a454621b522735458bfa209 2023-11-01 09:55:57,928 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311015cd3184f5b9f4faab810bdb3da7d7a2f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311015cd3184f5b9f4faab810bdb3da7d7a2f 2023-11-01 09:55:57,979 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/d29891a2461044b1b2e201183e00f047 2023-11-01 09:55:57,981 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101d06b375e5a364100b17034bc80e7ef70 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231101d06b375e5a364100b17034bc80e7ef70 2023-11-01 09:55:57,983 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/74d6b40a07134ecd84e8bde812feb4cb as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/74d6b40a07134ecd84e8bde812feb4cb 2023-11-01 09:55:57,987 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/74d6b40a07134ecd84e8bde812feb4cb, entries=4, sequenceid=13, filesize=5.4 K 2023-11-01 09:55:57,988 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/d29891a2461044b1b2e201183e00f047 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/d29891a2461044b1b2e201183e00f047 2023-11-01 09:55:57,991 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/d29891a2461044b1b2e201183e00f047, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:55:57,992 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cea8e1796b56252af8d44bbee2eec2a1 in 483ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:57,992 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:55:57,992 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:55:58,333 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/63559233346f491f9c0049779c0c788c 2023-11-01 09:55:58,386 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/17f7c3014e46403f927ea156ba41dc34 2023-11-01 09:55:58,390 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/5c280c7ea8034b87811f4b42af1b7446 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/5c280c7ea8034b87811f4b42af1b7446 2023-11-01 09:55:58,393 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/5c280c7ea8034b87811f4b42af1b7446, entries=4, sequenceid=13, filesize=5.4 K 2023-11-01 09:55:58,393 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/17f7c3014e46403f927ea156ba41dc34 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/17f7c3014e46403f927ea156ba41dc34 2023-11-01 09:55:58,396 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/17f7c3014e46403f927ea156ba41dc34, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:55:58,397 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2e105341a2540afe949315054ef0502f in 889ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:58,397 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:55:58,397 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:58,397 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:55:58,414 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:55:58,745 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311014e1a0915d1ea4e69b6524baecdd20144 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311014e1a0915d1ea4e69b6524baecdd20144 2023-11-01 09:55:59,150 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/72afe7d76c0b452f93b084bd2fe0643e 2023-11-01 09:55:59,154 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/63559233346f491f9c0049779c0c788c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/63559233346f491f9c0049779c0c788c 2023-11-01 09:55:59,157 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/63559233346f491f9c0049779c0c788c, entries=4, sequenceid=13, filesize=5.4 K 2023-11-01 09:55:59,157 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/72afe7d76c0b452f93b084bd2fe0643e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/72afe7d76c0b452f93b084bd2fe0643e 2023-11-01 09:55:59,160 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/72afe7d76c0b452f93b084bd2fe0643e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:55:59,161 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 46e683a163a0dbf6891bd67423ae4815 in 1653ms, sequenceid=13, compaction requested=true 2023-11-01 09:55:59,161 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:55:59,161 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:59,161 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:55:59,161 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:55:59,161 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,162 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-01 09:55:59,162 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-01 09:55:59,163 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:59,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:59,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,163 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:55:59,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:59,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-01 09:55:59,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d35bebb[Count = 0] remaining members to acquire global barrier 2023-11-01 09:55:59,165 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-01 09:55:59,165 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,166 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,166 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-01 09:55:59,166 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-01 09:55:59,166 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:55:59,166 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,166 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:55:59,167 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:59,167 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-01 09:55:59,167 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:59,168 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-01 09:55:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:55:59,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-01 09:55:59,170 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-01 09:55:59,170 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:55:59,170 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:55:59,170 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-01 09:55:59,170 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:55:59,175 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,175 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,175 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:55:59,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:59,176 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:59,177 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:55:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:55:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:59,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:59,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-01 09:55:59,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:55:59,179 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:55:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:55:59,179 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,279 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:55:59,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:55:59,281 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:59,282 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:59,282 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:55:59,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:55:59,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-01 09:55:59,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-01 09:55:59,285 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-01 09:55:59,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:59,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-01 09:55:59,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-01 09:55:59,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:59,287 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,287 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:55:59,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:55:59,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:55:59,288 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:55:59,288 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:55:59,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:59,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:55:59,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:55:59,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:55:59,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-01 09:55:59,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-01 09:55:59,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-01 09:55:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-01 09:55:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:55:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-01 09:55:59,289 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:55:59,289 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. started... 2023-11-01 09:55:59,289 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46e683a163a0dbf6891bd67423ae4815 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:55:59,291 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:55:59,291 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. started... 2023-11-01 09:55:59,291 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2e105341a2540afe949315054ef0502f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:55:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:55:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:55:59,294 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:55:59,294 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. started... 2023-11-01 09:55:59,294 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cea8e1796b56252af8d44bbee2eec2a1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:55:59,315 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311015d7a1140c58240cc8132b9ea5f255d08 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311015d7a1140c58240cc8132b9ea5f255d08 2023-11-01 09:55:59,315 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311013ec22e8faaec4dd9a53cae063676f26b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311013ec22e8faaec4dd9a53cae063676f26b 2023-11-01 09:55:59,317 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110151682c0f3b334bde90ccd7ef320bb6a9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023110151682c0f3b334bde90ccd7ef320bb6a9 2023-11-01 09:55:59,730 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/80478303ff2b4dada941db4580ae2bbc 2023-11-01 09:55:59,730 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/36e09aa6351347f89efa4017a80a8f2b 2023-11-01 09:55:59,731 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/ad239ade79a4424f83945112d99a8c8c 2023-11-01 09:56:00,144 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101daa2e0a7f92745cc921919a7a1e55ef4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231101daa2e0a7f92745cc921919a7a1e55ef4 2023-11-01 09:56:00,144 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101bf4be1924c0945a9864e8a3fd0f23bb2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231101bf4be1924c0945a9864e8a3fd0f23bb2 2023-11-01 09:56:00,144 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101f5473074dcf24eb7bfdbf6a770d31196 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231101f5473074dcf24eb7bfdbf6a770d31196 2023-11-01 09:56:00,549 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/c4b5b903ca764eb3b8cca4c30ca04fc2 2023-11-01 09:56:00,549 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/784682a918904b1bbbabf73e321e3be9 2023-11-01 09:56:00,550 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/cf1dd2e10a244f8cad0701a7de5c7bb7 2023-11-01 09:56:00,554 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/36e09aa6351347f89efa4017a80a8f2b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/36e09aa6351347f89efa4017a80a8f2b 2023-11-01 09:56:00,554 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/80478303ff2b4dada941db4580ae2bbc as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/80478303ff2b4dada941db4580ae2bbc 2023-11-01 09:56:00,554 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/ad239ade79a4424f83945112d99a8c8c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/ad239ade79a4424f83945112d99a8c8c 2023-11-01 09:56:00,561 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/80478303ff2b4dada941db4580ae2bbc, entries=4, sequenceid=17, filesize=5.4 K 2023-11-01 09:56:00,561 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/36e09aa6351347f89efa4017a80a8f2b, entries=4, sequenceid=17, filesize=5.4 K 2023-11-01 09:56:00,562 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/784682a918904b1bbbabf73e321e3be9 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/784682a918904b1bbbabf73e321e3be9 2023-11-01 09:56:00,562 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/cf1dd2e10a244f8cad0701a7de5c7bb7 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf1dd2e10a244f8cad0701a7de5c7bb7 2023-11-01 09:56:00,562 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/ad239ade79a4424f83945112d99a8c8c, entries=4, sequenceid=17, filesize=5.4 K 2023-11-01 09:56:00,563 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/c4b5b903ca764eb3b8cca4c30ca04fc2 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/c4b5b903ca764eb3b8cca4c30ca04fc2 2023-11-01 09:56:00,566 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/784682a918904b1bbbabf73e321e3be9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:56:00,567 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 46e683a163a0dbf6891bd67423ae4815 in 1278ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:00,567 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:56:00,567 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:00,567 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:00,570 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf1dd2e10a244f8cad0701a7de5c7bb7, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:56:00,570 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2e105341a2540afe949315054ef0502f in 1279ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:00,570 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:56:00,570 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:00,570 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:00,574 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/c4b5b903ca764eb3b8cca4c30ca04fc2, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:56:00,575 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cea8e1796b56252af8d44bbee2eec2a1 in 1281ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:00,575 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:56:00,575 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-01 09:56:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-01 09:56:00,577 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:00,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-01 09:56:00,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fa0706b[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:00,579 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-01 09:56:00,579 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,581 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-01 09:56:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-01 09:56:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:00,581 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,581 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-01 09:56:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:00,582 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-01 09:56:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:00,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-01 09:56:00,586 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-01 09:56:00,586 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:00,586 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:00,586 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-01 09:56:00,586 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:00,587 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,587 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:00,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,588 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:00,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:00,589 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:00,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:00,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,590 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:00,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:00,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,593 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:00,593 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,594 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:00,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:00,593 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:00,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-01 09:56:00,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:00,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:00,594 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:00,595 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,694 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:00,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:00,703 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:00,709 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:00,716 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:00,717 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:00,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-01 09:56:00,744 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-01 09:56:00,744 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:00,744 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-01 09:56:00,744 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-01 09:56:00,745 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,745 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:00,747 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:00,747 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:00,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:00,747 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:00,748 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:00,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:00,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:00,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:00,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:00,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-01 09:56:00,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-01 09:56:00,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-01 09:56:00,748 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-01 09:56:00,748 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:00,748 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-01 09:56:00,749 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:00,749 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. started... 2023-11-01 09:56:00,749 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:56:00,749 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 46e683a163a0dbf6891bd67423ae4815 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:56:00,749 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:00,749 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:00,749 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:00,749 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. started... 2023-11-01 09:56:00,749 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. started... 2023-11-01 09:56:00,749 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cea8e1796b56252af8d44bbee2eec2a1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:56:00,749 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2e105341a2540afe949315054ef0502f 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:56:01,169 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/bf442b6a254a4772ae9a425d56160db6 2023-11-01 09:56:01,171 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/55f9996fccb0498f949aca81f0804946 2023-11-01 09:56:01,176 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf442b6a254a4772ae9a425d56160db6 2023-11-01 09:56:01,177 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55f9996fccb0498f949aca81f0804946 2023-11-01 09:56:01,571 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/e9740608c0754809bf34cfaf785c307e 2023-11-01 09:56:01,575 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9740608c0754809bf34cfaf785c307e 2023-11-01 09:56:01,601 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/abebc4c339864378b180f57047e42cbe 2023-11-01 09:56:01,601 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/bdd5243264fc42f2a6518cc1b6893b15 2023-11-01 09:56:01,604 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for abebc4c339864378b180f57047e42cbe 2023-11-01 09:56:01,605 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdd5243264fc42f2a6518cc1b6893b15 2023-11-01 09:56:01,605 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/bf442b6a254a4772ae9a425d56160db6 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/bf442b6a254a4772ae9a425d56160db6 2023-11-01 09:56:01,605 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/55f9996fccb0498f949aca81f0804946 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/55f9996fccb0498f949aca81f0804946 2023-11-01 09:56:01,609 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf442b6a254a4772ae9a425d56160db6 2023-11-01 09:56:01,610 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/bf442b6a254a4772ae9a425d56160db6, entries=3, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:01,610 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55f9996fccb0498f949aca81f0804946 2023-11-01 09:56:01,610 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/55f9996fccb0498f949aca81f0804946, entries=3, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:01,611 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/abebc4c339864378b180f57047e42cbe as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/abebc4c339864378b180f57047e42cbe 2023-11-01 09:56:01,611 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/bdd5243264fc42f2a6518cc1b6893b15 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/bdd5243264fc42f2a6518cc1b6893b15 2023-11-01 09:56:01,626 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for abebc4c339864378b180f57047e42cbe 2023-11-01 09:56:01,626 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/abebc4c339864378b180f57047e42cbe, entries=1, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:01,626 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2e105341a2540afe949315054ef0502f in 877ms, sequenceid=23, compaction requested=true 2023-11-01 09:56:01,627 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:56:01,627 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:01,627 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:01,628 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdd5243264fc42f2a6518cc1b6893b15 2023-11-01 09:56:01,628 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/bdd5243264fc42f2a6518cc1b6893b15, entries=1, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:01,629 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cea8e1796b56252af8d44bbee2eec2a1 in 880ms, sequenceid=23, compaction requested=true 2023-11-01 09:56:01,629 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:56:01,629 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:01,629 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:02,389 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/37c7257bc2c54859b446c4e7f248b901 2023-11-01 09:56:02,394 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37c7257bc2c54859b446c4e7f248b901 2023-11-01 09:56:02,394 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/e9740608c0754809bf34cfaf785c307e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/e9740608c0754809bf34cfaf785c307e 2023-11-01 09:56:02,398 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9740608c0754809bf34cfaf785c307e 2023-11-01 09:56:02,399 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/e9740608c0754809bf34cfaf785c307e, entries=3, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:02,399 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/37c7257bc2c54859b446c4e7f248b901 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/37c7257bc2c54859b446c4e7f248b901 2023-11-01 09:56:02,403 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37c7257bc2c54859b446c4e7f248b901 2023-11-01 09:56:02,403 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/37c7257bc2c54859b446c4e7f248b901, entries=1, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:02,404 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 46e683a163a0dbf6891bd67423ae4815 in 1655ms, sequenceid=23, compaction requested=true 2023-11-01 09:56:02,404 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:56:02,404 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-01 09:56:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-01 09:56:02,406 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:02,407 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:02,407 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:02,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-01 09:56:02,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7026a77e[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:02,408 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-01 09:56:02,409 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,410 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,410 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-01 09:56:02,410 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-01 09:56:02,410 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:02,410 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,410 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:02,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-01 09:56:02,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:02,411 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,411 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-01 09:56:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:02,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:02,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:02,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:02,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:02,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-01 09:56:02,414 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-01 09:56:02,414 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:02,414 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:02,414 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-01 09:56:02,414 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:02,421 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,421 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:02,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,421 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:02,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:02,422 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:02,423 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-01 09:56:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:02,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:02,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:02,426 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-01 09:56:02,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-01 09:56:02,427 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-01 09:56:02,426 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:02,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:02,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:02,427 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:02,427 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:02,527 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:02,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:02,529 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:02,529 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 46e683a163a0dbf6891bd67423ae4815/family1 is initiating major compaction (all files) 2023-11-01 09:56:02,529 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:02,529 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:02,529 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 46e683a163a0dbf6891bd67423ae4815/family1 in ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:02,530 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/7faaf0fb33424ad3b39e42568c530055, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/eafd598b15ee439bba8b31b9ec602919, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/63559233346f491f9c0049779c0c788c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/36e09aa6351347f89efa4017a80a8f2b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/e9740608c0754809bf34cfaf785c307e] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp, totalSize=26.6 K 2023-11-01 09:56:02,530 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 7faaf0fb33424ad3b39e42568c530055, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832553881 2023-11-01 09:56:02,531 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting eafd598b15ee439bba8b31b9ec602919, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832555666 2023-11-01 09:56:02,531 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 63559233346f491f9c0049779c0c788c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832557497 2023-11-01 09:56:02,532 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 36e09aa6351347f89efa4017a80a8f2b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832559282 2023-11-01 09:56:02,532 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e9740608c0754809bf34cfaf785c307e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:02,543 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 46e683a163a0dbf6891bd67423ae4815#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:02,559 WARN [DataStreamer for file /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311015fba5200a0114f0894a0b88ca40f6d78_del] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-11-01 09:56:02,564 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311015fba5200a0114f0894a0b88ca40f6d78_del 2023-11-01 09:56:02,564 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311015fba5200a0114f0894a0b88ca40f6d78_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311015fba5200a0114f0894a0b88ca40f6d78_del 2023-11-01 09:56:02,983 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72b3a11fbaf54c45a0880451fe62e4cf 2023-11-01 09:56:02,984 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family1/72b3a11fbaf54c45a0880451fe62e4cf as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/72b3a11fbaf54c45a0880451fe62e4cf 2023-11-01 09:56:02,988 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72b3a11fbaf54c45a0880451fe62e4cf 2023-11-01 09:56:02,989 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46e683a163a0dbf6891bd67423ae4815/family1 of 46e683a163a0dbf6891bd67423ae4815 into 72b3a11fbaf54c45a0880451fe62e4cf(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:02,989 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:56:02,989 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:02,989 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 46e683a163a0dbf6891bd67423ae4815/family2 is initiating major compaction (all files) 2023-11-01 09:56:02,989 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:02,989 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:02,990 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 46e683a163a0dbf6891bd67423ae4815/family2 in ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:02,991 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/66c04b1f74804207bf276bf5b357e54c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/6c3820f094654c01bbc34715eff34a40, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/72afe7d76c0b452f93b084bd2fe0643e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/784682a918904b1bbbabf73e321e3be9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/37c7257bc2c54859b446c4e7f248b901] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp, totalSize=25.3 K 2023-11-01 09:56:02,991 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 66c04b1f74804207bf276bf5b357e54c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832553881 2023-11-01 09:56:02,991 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6c3820f094654c01bbc34715eff34a40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832555666 2023-11-01 09:56:02,992 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 72afe7d76c0b452f93b084bd2fe0643e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832557497 2023-11-01 09:56:02,992 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 784682a918904b1bbbabf73e321e3be9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832559282 2023-11-01 09:56:02,992 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 37c7257bc2c54859b446c4e7f248b901, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:03,002 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 46e683a163a0dbf6891bd67423ae4815#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:03,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/7faaf0fb33424ad3b39e42568c530055, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/eafd598b15ee439bba8b31b9ec602919, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/63559233346f491f9c0049779c0c788c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/36e09aa6351347f89efa4017a80a8f2b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/e9740608c0754809bf34cfaf785c307e] to archive 2023-11-01 09:56:03,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:03,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/7faaf0fb33424ad3b39e42568c530055 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/7faaf0fb33424ad3b39e42568c530055 2023-11-01 09:56:03,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/eafd598b15ee439bba8b31b9ec602919 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/eafd598b15ee439bba8b31b9ec602919 2023-11-01 09:56:03,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/63559233346f491f9c0049779c0c788c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/63559233346f491f9c0049779c0c788c 2023-11-01 09:56:03,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/36e09aa6351347f89efa4017a80a8f2b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/36e09aa6351347f89efa4017a80a8f2b 2023-11-01 09:56:03,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/e9740608c0754809bf34cfaf785c307e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/e9740608c0754809bf34cfaf785c307e 2023-11-01 09:56:03,412 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231101bc6a9d5d1fb146fe99d132df4312abd7_del 2023-11-01 09:56:03,412 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101bc6a9d5d1fb146fe99d132df4312abd7_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231101bc6a9d5d1fb146fe99d132df4312abd7_del 2023-11-01 09:56:03,828 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bebc3072fc444f7ae9d8c0bc75b5987 2023-11-01 09:56:03,829 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/.tmp/family2/1bebc3072fc444f7ae9d8c0bc75b5987 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/1bebc3072fc444f7ae9d8c0bc75b5987 2023-11-01 09:56:03,833 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bebc3072fc444f7ae9d8c0bc75b5987 2023-11-01 09:56:03,834 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46e683a163a0dbf6891bd67423ae4815/family2 of 46e683a163a0dbf6891bd67423ae4815 into 1bebc3072fc444f7ae9d8c0bc75b5987(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:03,835 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:56:03,835 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:03,835 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 2e105341a2540afe949315054ef0502f/family1 is initiating major compaction (all files) 2023-11-01 09:56:03,835 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:03,835 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:03,836 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 2e105341a2540afe949315054ef0502f/family1 in ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:03,836 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/318de5ed4a174461856c3dafcdc02c6e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/7e31f91e70fb4715aebb269801be2757, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/5c280c7ea8034b87811f4b42af1b7446, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/80478303ff2b4dada941db4580ae2bbc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/bf442b6a254a4772ae9a425d56160db6] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp, totalSize=26.6 K 2023-11-01 09:56:03,837 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 318de5ed4a174461856c3dafcdc02c6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832553881 2023-11-01 09:56:03,837 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 7e31f91e70fb4715aebb269801be2757, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832555666 2023-11-01 09:56:03,838 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 5c280c7ea8034b87811f4b42af1b7446, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832557498 2023-11-01 09:56:03,838 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 80478303ff2b4dada941db4580ae2bbc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832559282 2023-11-01 09:56:03,838 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting bf442b6a254a4772ae9a425d56160db6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:03,849 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 2e105341a2540afe949315054ef0502f#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:03,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/66c04b1f74804207bf276bf5b357e54c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/6c3820f094654c01bbc34715eff34a40, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/72afe7d76c0b452f93b084bd2fe0643e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/784682a918904b1bbbabf73e321e3be9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/37c7257bc2c54859b446c4e7f248b901] to archive 2023-11-01 09:56:03,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:03,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/66c04b1f74804207bf276bf5b357e54c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/66c04b1f74804207bf276bf5b357e54c 2023-11-01 09:56:03,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/6c3820f094654c01bbc34715eff34a40 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/6c3820f094654c01bbc34715eff34a40 2023-11-01 09:56:03,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/72afe7d76c0b452f93b084bd2fe0643e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/72afe7d76c0b452f93b084bd2fe0643e 2023-11-01 09:56:03,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/784682a918904b1bbbabf73e321e3be9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/784682a918904b1bbbabf73e321e3be9 2023-11-01 09:56:03,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/37c7257bc2c54859b446c4e7f248b901 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family2/37c7257bc2c54859b446c4e7f248b901 2023-11-01 09:56:04,257 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110107362df43f3143cba79c606a7f3f23b6_del 2023-11-01 09:56:04,257 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110107362df43f3143cba79c606a7f3f23b6_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110107362df43f3143cba79c606a7f3f23b6_del 2023-11-01 09:56:05,071 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d983c726a43e454e96a1d87cb9af0942 2023-11-01 09:56:05,072 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family1/d983c726a43e454e96a1d87cb9af0942 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/d983c726a43e454e96a1d87cb9af0942 2023-11-01 09:56:05,075 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d983c726a43e454e96a1d87cb9af0942 2023-11-01 09:56:05,076 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2e105341a2540afe949315054ef0502f/family1 of 2e105341a2540afe949315054ef0502f into d983c726a43e454e96a1d87cb9af0942(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:56:05,076 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:56:05,076 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:05,077 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 2e105341a2540afe949315054ef0502f/family2 is initiating major compaction (all files) 2023-11-01 09:56:05,077 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:05,077 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:05,078 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 2e105341a2540afe949315054ef0502f/family2 in ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:05,078 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/a0f5a02fcc724c498947db0ee22cdbea, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf7bf310bdf64912ae253a68495299a0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/17f7c3014e46403f927ea156ba41dc34, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf1dd2e10a244f8cad0701a7de5c7bb7, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/abebc4c339864378b180f57047e42cbe] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp, totalSize=25.3 K 2023-11-01 09:56:05,078 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting a0f5a02fcc724c498947db0ee22cdbea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832553881 2023-11-01 09:56:05,078 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting cf7bf310bdf64912ae253a68495299a0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832555666 2023-11-01 09:56:05,079 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 17f7c3014e46403f927ea156ba41dc34, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832557498 2023-11-01 09:56:05,079 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting cf1dd2e10a244f8cad0701a7de5c7bb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832559282 2023-11-01 09:56:05,079 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting abebc4c339864378b180f57047e42cbe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:05,091 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 2e105341a2540afe949315054ef0502f#family2#compaction#153 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:05,097 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110169ad76ac8c774d289642413986152035_del 2023-11-01 09:56:05,098 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110169ad76ac8c774d289642413986152035_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023110169ad76ac8c774d289642413986152035_del 2023-11-01 09:56:05,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/318de5ed4a174461856c3dafcdc02c6e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/7e31f91e70fb4715aebb269801be2757, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/5c280c7ea8034b87811f4b42af1b7446, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/80478303ff2b4dada941db4580ae2bbc, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/bf442b6a254a4772ae9a425d56160db6] to archive 2023-11-01 09:56:05,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:05,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/318de5ed4a174461856c3dafcdc02c6e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/318de5ed4a174461856c3dafcdc02c6e 2023-11-01 09:56:05,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/7e31f91e70fb4715aebb269801be2757 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/7e31f91e70fb4715aebb269801be2757 2023-11-01 09:56:05,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/5c280c7ea8034b87811f4b42af1b7446 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/5c280c7ea8034b87811f4b42af1b7446 2023-11-01 09:56:05,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/80478303ff2b4dada941db4580ae2bbc to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/80478303ff2b4dada941db4580ae2bbc 2023-11-01 09:56:05,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/bf442b6a254a4772ae9a425d56160db6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/bf442b6a254a4772ae9a425d56160db6 2023-11-01 09:56:05,910 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dde6df813ddd42709d604b67a22e55b9 2023-11-01 09:56:05,911 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/.tmp/family2/dde6df813ddd42709d604b67a22e55b9 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/dde6df813ddd42709d604b67a22e55b9 2023-11-01 09:56:05,914 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dde6df813ddd42709d604b67a22e55b9 2023-11-01 09:56:05,915 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2e105341a2540afe949315054ef0502f/family2 of 2e105341a2540afe949315054ef0502f into dde6df813ddd42709d604b67a22e55b9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:05,915 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:56:05,915 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:05,915 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): cea8e1796b56252af8d44bbee2eec2a1/family1 is initiating major compaction (all files) 2023-11-01 09:56:05,915 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:05,915 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:05,916 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of cea8e1796b56252af8d44bbee2eec2a1/family1 in ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:05,916 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/c4cc80f29047445bb269f3f3dc496259, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/953a314f8335458a8e64124e3a04a967, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/74d6b40a07134ecd84e8bde812feb4cb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/ad239ade79a4424f83945112d99a8c8c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/55f9996fccb0498f949aca81f0804946] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp, totalSize=26.6 K 2023-11-01 09:56:05,916 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting c4cc80f29047445bb269f3f3dc496259, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832553880 2023-11-01 09:56:05,916 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 953a314f8335458a8e64124e3a04a967, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832555665 2023-11-01 09:56:05,917 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 74d6b40a07134ecd84e8bde812feb4cb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832557497 2023-11-01 09:56:05,917 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting ad239ade79a4424f83945112d99a8c8c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832559281 2023-11-01 09:56:05,917 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 55f9996fccb0498f949aca81f0804946, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:05,926 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): cea8e1796b56252af8d44bbee2eec2a1#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:05,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/a0f5a02fcc724c498947db0ee22cdbea, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf7bf310bdf64912ae253a68495299a0, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/17f7c3014e46403f927ea156ba41dc34, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf1dd2e10a244f8cad0701a7de5c7bb7, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/abebc4c339864378b180f57047e42cbe] to archive 2023-11-01 09:56:05,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:05,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/a0f5a02fcc724c498947db0ee22cdbea to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/a0f5a02fcc724c498947db0ee22cdbea 2023-11-01 09:56:05,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf7bf310bdf64912ae253a68495299a0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf7bf310bdf64912ae253a68495299a0 2023-11-01 09:56:05,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/17f7c3014e46403f927ea156ba41dc34 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/17f7c3014e46403f927ea156ba41dc34 2023-11-01 09:56:05,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf1dd2e10a244f8cad0701a7de5c7bb7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/cf1dd2e10a244f8cad0701a7de5c7bb7 2023-11-01 09:56:05,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/abebc4c339864378b180f57047e42cbe to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family2/abebc4c339864378b180f57047e42cbe 2023-11-01 09:56:06,335 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311012293db0356184e4eb3e23280a0b7a521_del 2023-11-01 09:56:06,335 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311012293db0356184e4eb3e23280a0b7a521_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311012293db0356184e4eb3e23280a0b7a521_del 2023-11-01 09:56:07,151 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcfcc7c8fa144a04b464e807678f9d7e 2023-11-01 09:56:07,152 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family1/fcfcc7c8fa144a04b464e807678f9d7e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/fcfcc7c8fa144a04b464e807678f9d7e 2023-11-01 09:56:07,156 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcfcc7c8fa144a04b464e807678f9d7e 2023-11-01 09:56:07,157 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cea8e1796b56252af8d44bbee2eec2a1/family1 of cea8e1796b56252af8d44bbee2eec2a1 into fcfcc7c8fa144a04b464e807678f9d7e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:56:07,157 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:56:07,157 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:07,158 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): cea8e1796b56252af8d44bbee2eec2a1/family2 is initiating major compaction (all files) 2023-11-01 09:56:07,158 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:07,158 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:07,158 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of cea8e1796b56252af8d44bbee2eec2a1/family2 in ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:07,158 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/2955574d3e3a481980cddf8d06373414, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/ec466eb5a52f46278944bfe7f5488686, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/d29891a2461044b1b2e201183e00f047, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/c4b5b903ca764eb3b8cca4c30ca04fc2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/bdd5243264fc42f2a6518cc1b6893b15] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp, totalSize=25.3 K 2023-11-01 09:56:07,158 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 2955574d3e3a481980cddf8d06373414, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832553880 2023-11-01 09:56:07,159 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting ec466eb5a52f46278944bfe7f5488686, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832555665 2023-11-01 09:56:07,159 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting d29891a2461044b1b2e201183e00f047, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832557497 2023-11-01 09:56:07,159 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting c4b5b903ca764eb3b8cca4c30ca04fc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832559281 2023-11-01 09:56:07,160 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting bdd5243264fc42f2a6518cc1b6893b15, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:07,169 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): cea8e1796b56252af8d44bbee2eec2a1#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:07,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/c4cc80f29047445bb269f3f3dc496259, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/953a314f8335458a8e64124e3a04a967, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/74d6b40a07134ecd84e8bde812feb4cb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/ad239ade79a4424f83945112d99a8c8c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/55f9996fccb0498f949aca81f0804946] to archive 2023-11-01 09:56:07,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:07,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/c4cc80f29047445bb269f3f3dc496259 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/c4cc80f29047445bb269f3f3dc496259 2023-11-01 09:56:07,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/953a314f8335458a8e64124e3a04a967 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/953a314f8335458a8e64124e3a04a967 2023-11-01 09:56:07,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/74d6b40a07134ecd84e8bde812feb4cb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/74d6b40a07134ecd84e8bde812feb4cb 2023-11-01 09:56:07,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/ad239ade79a4424f83945112d99a8c8c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/ad239ade79a4424f83945112d99a8c8c 2023-11-01 09:56:07,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/55f9996fccb0498f949aca81f0804946 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/55f9996fccb0498f949aca81f0804946 2023-11-01 09:56:07,580 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110117434ca203a544f6b075d347c4c3398a_del 2023-11-01 09:56:07,580 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110117434ca203a544f6b075d347c4c3398a_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023110117434ca203a544f6b075d347c4c3398a_del 2023-11-01 09:56:07,993 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6a47360ead3428080946d24e7bf3d5b 2023-11-01 09:56:07,993 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/.tmp/family2/b6a47360ead3428080946d24e7bf3d5b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/b6a47360ead3428080946d24e7bf3d5b 2023-11-01 09:56:07,997 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6a47360ead3428080946d24e7bf3d5b 2023-11-01 09:56:07,998 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cea8e1796b56252af8d44bbee2eec2a1/family2 of cea8e1796b56252af8d44bbee2eec2a1 into b6a47360ead3428080946d24e7bf3d5b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:07,998 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:56:08,001 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:08,004 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:08,007 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:08,007 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:08,012 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-01 09:56:08,026 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-01 09:56:08,028 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311012293db0356184e4eb3e23280a0b7a521_del 2023-11-01 09:56:08,031 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311015fba5200a0114f0894a0b88ca40f6d78_del 2023-11-01 09:56:08,034 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110107362df43f3143cba79c606a7f3f23b6_del 2023-11-01 09:56:08,034 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,035 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(139): Connect 0x199689fb to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:56:08,040 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c1de691, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:56:08,041 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231101 for table='ns:testMinorCompaction' and column='family1' 2023-11-01 09:56:08,041 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231101 for table='ns:testMinorCompaction' and column='family1' 2023-11-01 09:56:08,041 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231101 for table='ns:testMinorCompaction' and column='family1' 2023-11-01 09:56:08,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/2955574d3e3a481980cddf8d06373414, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/ec466eb5a52f46278944bfe7f5488686, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/d29891a2461044b1b2e201183e00f047, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/c4b5b903ca764eb3b8cca4c30ca04fc2, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/bdd5243264fc42f2a6518cc1b6893b15] to archive 2023-11-01 09:56:08,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:08,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/2955574d3e3a481980cddf8d06373414 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/2955574d3e3a481980cddf8d06373414 2023-11-01 09:56:08,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/ec466eb5a52f46278944bfe7f5488686 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/ec466eb5a52f46278944bfe7f5488686 2023-11-01 09:56:08,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/d29891a2461044b1b2e201183e00f047 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/d29891a2461044b1b2e201183e00f047 2023-11-01 09:56:08,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/c4b5b903ca764eb3b8cca4c30ca04fc2 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/c4b5b903ca764eb3b8cca4c30ca04fc2 2023-11-01 09:56:08,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/bdd5243264fc42f2a6518cc1b6893b15 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family2/bdd5243264fc42f2a6518cc1b6893b15 2023-11-01 09:56:08,469 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110112de5f3b40e34a64af34d0fa3678f263 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023110112de5f3b40e34a64af34d0fa3678f263 2023-11-01 09:56:08,470 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,482 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:56:08,485 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:56:08,492 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:56:08,499 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:56:08,510 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231101/family1/d90d47857e50475ea81a8f4d6b8aee80 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-01 09:56:08,510 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231101/family1/d90d47857e50475ea81a8f4d6b8aee80}] 2023-11-01 09:56:08,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231101/family1/d90d47857e50475ea81a8f4d6b8aee80 for inclusion in 46e683a163a0dbf6891bd67423ae4815/family1 2023-11-01 09:56:08,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-01 09:56:08,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-01 09:56:08,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:56:08,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231101/family1/d90d47857e50475ea81a8f4d6b8aee80 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__3v60r8n702s47l4ackdv8uvffaqkgsm1saudlutd23im04hk3k5a7kfpmlnq34qn/family1/d90d47857e50475ea81a8f4d6b8aee80 2023-11-01 09:56:08,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__3v60r8n702s47l4ackdv8uvffaqkgsm1saudlutd23im04hk3k5a7kfpmlnq34qn/family1/d90d47857e50475ea81a8f4d6b8aee80 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/a91c43b83749465893c2097d90c54028_SeqId_28_ 2023-11-01 09:56:08,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__3v60r8n702s47l4ackdv8uvffaqkgsm1saudlutd23im04hk3k5a7kfpmlnq34qn/family1/d90d47857e50475ea81a8f4d6b8aee80 into 46e683a163a0dbf6891bd67423ae4815/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/a91c43b83749465893c2097d90c54028_SeqId_28_ - updating store file list. 2023-11-01 09:56:08,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/a91c43b83749465893c2097d90c54028_SeqId_28_ into 46e683a163a0dbf6891bd67423ae4815/family1 2023-11-01 09:56:08,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__3v60r8n702s47l4ackdv8uvffaqkgsm1saudlutd23im04hk3k5a7kfpmlnq34qn/family1/d90d47857e50475ea81a8f4d6b8aee80 into 46e683a163a0dbf6891bd67423ae4815/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/family1/a91c43b83749465893c2097d90c54028_SeqId_28_) 2023-11-01 09:56:08,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__3v60r8n702s47l4ackdv8uvffaqkgsm1saudlutd23im04hk3k5a7kfpmlnq34qn/family1/d90d47857e50475ea81a8f4d6b8aee80 2023-11-01 09:56:08,527 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,528 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:08,529 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231101b4f0b8265b5549dba8c3089ee7f4dc2e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231101b4f0b8265b5549dba8c3089ee7f4dc2e 2023-11-01 09:56:08,530 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-01 09:56:08,530 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231101' 2023-11-01 09:56:08,530 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231101 for table='ns:testMinorCompaction' and column='family1' 2023-11-01 09:56:08,870 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110155b4b9398863438a8ff72f8b83d494c9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023110155b4b9398863438a8ff72f8b83d494c9 2023-11-01 09:56:08,870 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110171ea268541be4e9894bcb97327aa2690 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110171ea268541be4e9894bcb97327aa2690 2023-11-01 09:56:08,871 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,871 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,914 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:56:08,914 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6912cabe to 127.0.0.1:49762 2023-11-01 09:56:08,914 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:08,914 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/family1/a148c60abd884d30a55d54fa3283eae0 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-01 09:56:08,915 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/family1/a148c60abd884d30a55d54fa3283eae0}] 2023-11-01 09:56:08,916 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:56:08,916 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d29c2b9 to 127.0.0.1:49762 2023-11-01 09:56:08,916 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:08,916 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231101/family1/74fdf24449f4489b807ce3dbd5a2649a first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-01 09:56:08,917 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231101/family1/74fdf24449f4489b807ce3dbd5a2649a}] 2023-11-01 09:56:08,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/family1/a148c60abd884d30a55d54fa3283eae0 for inclusion in cea8e1796b56252af8d44bbee2eec2a1/family1 2023-11-01 09:56:08,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231101/family1/74fdf24449f4489b807ce3dbd5a2649a for inclusion in 2e105341a2540afe949315054ef0502f/family1 2023-11-01 09:56:08,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-01 09:56:08,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last=1 2023-11-01 09:56:08,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-01 09:56:08,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:56:08,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-01 09:56:08,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:56:08,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231101/family1/a148c60abd884d30a55d54fa3283eae0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__8a55s8q5oiclksi5latsojgpai45puf3t6mb8ekd4inpjmps6nr96mt32vugg1hl/family1/a148c60abd884d30a55d54fa3283eae0 2023-11-01 09:56:08,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231101/family1/74fdf24449f4489b807ce3dbd5a2649a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__t357lgqvbn6roscvfuh1knvrp0vs3r4sq1lqmevnt5i2u8qa16c8sie42tg65cc/family1/74fdf24449f4489b807ce3dbd5a2649a 2023-11-01 09:56:08,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__8a55s8q5oiclksi5latsojgpai45puf3t6mb8ekd4inpjmps6nr96mt32vugg1hl/family1/a148c60abd884d30a55d54fa3283eae0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/17116ce551e34276ae0dbc0517da881d_SeqId_28_ 2023-11-01 09:56:08,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__t357lgqvbn6roscvfuh1knvrp0vs3r4sq1lqmevnt5i2u8qa16c8sie42tg65cc/family1/74fdf24449f4489b807ce3dbd5a2649a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/f22a6f2502744d41aa86cba97e3769bb_SeqId_28_ 2023-11-01 09:56:08,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__8a55s8q5oiclksi5latsojgpai45puf3t6mb8ekd4inpjmps6nr96mt32vugg1hl/family1/a148c60abd884d30a55d54fa3283eae0 into cea8e1796b56252af8d44bbee2eec2a1/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/17116ce551e34276ae0dbc0517da881d_SeqId_28_ - updating store file list. 2023-11-01 09:56:08,926 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__t357lgqvbn6roscvfuh1knvrp0vs3r4sq1lqmevnt5i2u8qa16c8sie42tg65cc/family1/74fdf24449f4489b807ce3dbd5a2649a into 2e105341a2540afe949315054ef0502f/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/f22a6f2502744d41aa86cba97e3769bb_SeqId_28_ - updating store file list. 2023-11-01 09:56:08,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/17116ce551e34276ae0dbc0517da881d_SeqId_28_ into cea8e1796b56252af8d44bbee2eec2a1/family1 2023-11-01 09:56:08,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/f22a6f2502744d41aa86cba97e3769bb_SeqId_28_ into 2e105341a2540afe949315054ef0502f/family1 2023-11-01 09:56:08,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__8a55s8q5oiclksi5latsojgpai45puf3t6mb8ekd4inpjmps6nr96mt32vugg1hl/family1/a148c60abd884d30a55d54fa3283eae0 into cea8e1796b56252af8d44bbee2eec2a1/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/family1/17116ce551e34276ae0dbc0517da881d_SeqId_28_) 2023-11-01 09:56:08,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__t357lgqvbn6roscvfuh1knvrp0vs3r4sq1lqmevnt5i2u8qa16c8sie42tg65cc/family1/74fdf24449f4489b807ce3dbd5a2649a into 2e105341a2540afe949315054ef0502f/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/family1/f22a6f2502744d41aa86cba97e3769bb_SeqId_28_) 2023-11-01 09:56:08,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__8a55s8q5oiclksi5latsojgpai45puf3t6mb8ekd4inpjmps6nr96mt32vugg1hl/family1/a148c60abd884d30a55d54fa3283eae0 2023-11-01 09:56:08,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__ns_testMinorCompaction__t357lgqvbn6roscvfuh1knvrp0vs3r4sq1lqmevnt5i2u8qa16c8sie42tg65cc/family1/74fdf24449f4489b807ce3dbd5a2649a 2023-11-01 09:56:08,931 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,931 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,932 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:08,932 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:08,933 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311010300819c9a3c44e9b0499817a7b6c098 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311010300819c9a3c44e9b0499817a7b6c098 2023-11-01 09:56:08,933 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231101cda6896868b64a428f17a8560088cb13 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231101cda6896868b64a428f17a8560088cb13 2023-11-01 09:56:08,933 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-01 09:56:08,933 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231101' 2023-11-01 09:56:08,933 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-01 09:56:08,933 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231101' 2023-11-01 09:56:08,934 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231101 for table='ns:testMinorCompaction' and column='family1' 2023-11-01 09:56:08,934 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231101 for table='ns:testMinorCompaction' and column='family1' 2023-11-01 09:56:08,934 INFO [Listener at localhost/37085] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-01 09:56:08,936 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:08,937 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:08,940 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:08,940 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:08,956 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=257 (was 287), OpenFileDescriptor=635 (was 762), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 139), ProcessCount=172 (was 172), AvailableMemoryMB=10829 (was 10490) - AvailableMemoryMB LEAK? - 2023-11-01 09:56:08,967 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=257, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=172, AvailableMemoryMB=10828 2023-11-01 09:56:08,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-01 09:56:08,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:08,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:56:08,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-01 09:56:08,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:56:08,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-01 09:56:08,972 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:08,973 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef empty. 2023-11-01 09:56:08,973 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:08,973 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-01 09:56:09,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-01 09:56:09,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-01 09:56:09,384 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-01 09:56:09,385 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => bf7cf4be28cce55b870b7451ab8d5fef, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:56:09,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-01 09:56:09,790 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:09,790 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing bf7cf4be28cce55b870b7451ab8d5fef, disabling compactions & flushes 2023-11-01 09:56:09,790 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:09,790 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:09,790 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. after waiting 0 ms 2023-11-01 09:56:09,790 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:09,790 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:09,790 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:09,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:56:09,793 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698832569793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832569793"}]},"ts":"1698832569793"} 2023-11-01 09:56:09,794 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-01 09:56:09,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:56:09,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832569795"}]},"ts":"1698832569795"} 2023-11-01 09:56:09,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-01 09:56:09,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bf7cf4be28cce55b870b7451ab8d5fef, ASSIGN}] 2023-11-01 09:56:09,800 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bf7cf4be28cce55b870b7451ab8d5fef, ASSIGN 2023-11-01 09:56:09,801 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bf7cf4be28cce55b870b7451ab8d5fef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:56:09,952 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=bf7cf4be28cce55b870b7451ab8d5fef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:09,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698832569952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832569952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832569952"}]},"ts":"1698832569952"} 2023-11-01 09:56:09,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure bf7cf4be28cce55b870b7451ab8d5fef, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:56:10,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-01 09:56:10,105 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:10,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:10,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf7cf4be28cce55b870b7451ab8d5fef, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.', STARTKEY => '', ENDKEY => ''} 2023-11-01 09:56:10,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:10,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,109 INFO [StoreOpener-bf7cf4be28cce55b870b7451ab8d5fef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,110 DEBUG [StoreOpener-bf7cf4be28cce55b870b7451ab8d5fef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:10,110 DEBUG [StoreOpener-bf7cf4be28cce55b870b7451ab8d5fef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:10,110 INFO [StoreOpener-bf7cf4be28cce55b870b7451ab8d5fef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf7cf4be28cce55b870b7451ab8d5fef columnFamilyName family1 2023-11-01 09:56:10,112 INFO [StoreOpener-bf7cf4be28cce55b870b7451ab8d5fef-1] regionserver.HStore(310): Store=bf7cf4be28cce55b870b7451ab8d5fef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:10,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:10,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:56:10,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf7cf4be28cce55b870b7451ab8d5fef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68588458, jitterRate=0.02204766869544983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-01 09:56:10,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:10,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef., pid=114, masterSystemTime=1698832570105 2023-11-01 09:56:10,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:10,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:10,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=bf7cf4be28cce55b870b7451ab8d5fef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:10,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698832570119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832570119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832570119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832570119"}]},"ts":"1698832570119"} 2023-11-01 09:56:10,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-01 09:56:10,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure bf7cf4be28cce55b870b7451ab8d5fef, server=jenkins-hbase4.apache.org,40233,1698832432817 in 167 msec 2023-11-01 09:56:10,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-01 09:56:10,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=bf7cf4be28cce55b870b7451ab8d5fef, ASSIGN in 322 msec 2023-11-01 09:56:10,123 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:56:10,123 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832570123"}]},"ts":"1698832570123"} 2023-11-01 09:56:10,124 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-01 09:56:10,126 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:56:10,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1570 sec 2023-11-01 09:56:11,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-01 09:56:11,077 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-01 09:56:11,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:11,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,100 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:11,100 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:11,100 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:11,100 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:11,101 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,101 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,103 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,103 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:11,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:11,103 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,103 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:11,104 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:11,111 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:11,111 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:11,111 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:11,112 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-01 09:56:11,535 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113008ce6aefd16f41798224003c2a00ed5e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113008ce6aefd16f41798224003c2a00ed5e 2023-11-01 09:56:11,939 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/01c29c8ea338493582f5662fce258a5c 2023-11-01 09:56:11,943 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/01c29c8ea338493582f5662fce258a5c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/01c29c8ea338493582f5662fce258a5c 2023-11-01 09:56:11,947 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/01c29c8ea338493582f5662fce258a5c, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-01 09:56:11,947 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 835ms, sequenceid=5, compaction requested=false 2023-11-01 09:56:11,947 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:11,948 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:11,948 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:11,948 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:11,949 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,950 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:11,950 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,950 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:11,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:11,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fd58306[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:11,951 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:11,951 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,952 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,952 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:11,952 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:11,952 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:11,952 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,952 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:11,954 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:11,954 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:11,954 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,954 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:11,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:11,956 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:11,956 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:11,956 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:11,956 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,956 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:11,961 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,961 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,961 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:11,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:11,962 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,963 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:11,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:11,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:11,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:11,965 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:11,965 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,065 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:12,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:12,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:12,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:12,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,071 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:12,071 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:12,071 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:12,071 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:12,071 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,072 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,073 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,073 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:12,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:12,073 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,073 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,074 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:12,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:12,074 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:12,074 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:12,074 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:12,074 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-01 09:56:12,488 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128512e6e01dc1942f3a3574bc25baa5050 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128512e6e01dc1942f3a3574bc25baa5050 2023-11-01 09:56:12,893 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/3e0c223eaae541c59bd4c2c5dab2ab8a 2023-11-01 09:56:12,897 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/3e0c223eaae541c59bd4c2c5dab2ab8a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/3e0c223eaae541c59bd4c2c5dab2ab8a 2023-11-01 09:56:12,900 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/3e0c223eaae541c59bd4c2c5dab2ab8a, entries=1, sequenceid=9, filesize=5.0 K 2023-11-01 09:56:12,900 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 826ms, sequenceid=9, compaction requested=false 2023-11-01 09:56:12,901 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:12,901 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:12,901 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:12,901 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:12,901 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,901 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:12,901 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:12,902 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,902 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:12,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:12,903 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,903 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:12,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:12,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:12,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fd53c21[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:12,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:12,904 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,906 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:12,907 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:12,907 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,907 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:12,908 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:12,908 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,908 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:12,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:12,908 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:12,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:12,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:12,910 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:12,910 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:12,910 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:12,910 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,910 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:12,912 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,912 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:12,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,912 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:12,912 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,913 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,915 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:12,915 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:12,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:12,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:12,915 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:12,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:56:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:12,915 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:12,915 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:12,916 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:12,915 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:12,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:12,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:12,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:12,916 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,016 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:13,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:13,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:13,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:13,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,021 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:13,021 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:13,022 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:13,022 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:13,022 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,022 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,026 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,026 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:13,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:13,026 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,026 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,027 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:13,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:13,028 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:13,028 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:13,028 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:13,028 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:13,439 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011caf5e3a2a27437f94efe29bd7751c73 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512011caf5e3a2a27437f94efe29bd7751c73 2023-11-01 09:56:13,845 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/5d6e123f908c46f8b367b53bb79135a7 2023-11-01 09:56:13,849 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/5d6e123f908c46f8b367b53bb79135a7 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/5d6e123f908c46f8b367b53bb79135a7 2023-11-01 09:56:13,852 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/5d6e123f908c46f8b367b53bb79135a7, entries=1, sequenceid=13, filesize=4.9 K 2023-11-01 09:56:13,853 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 825ms, sequenceid=13, compaction requested=true 2023-11-01 09:56:13,853 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:13,853 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:13,853 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:13,853 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:13,853 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,853 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:13,853 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:13,854 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,854 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:13,855 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,855 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:13,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:13,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@136a3698[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:13,856 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:13,856 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,857 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,857 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:13,857 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:13,857 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:13,857 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,857 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:13,859 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:13,860 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:13,860 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,860 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:13,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:13,862 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:13,862 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:13,862 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:13,862 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,862 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:13,863 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,863 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:13,863 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:13,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:13,864 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,865 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:13,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,867 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:13,867 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:13,868 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:13,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:13,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:13,867 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,867 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:13,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,868 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,968 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:13,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:13,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,974 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:13,974 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:13,974 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:13,974 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:13,975 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,975 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,976 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,976 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:13,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:13,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:13,976 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:13,976 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:13,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:13,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:13,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:13,977 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:13,977 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:13,977 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:13,978 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:13,978 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:13,978 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:14,388 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054fa764053bd84e549addb5b5dd22ec19 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512054fa764053bd84e549addb5b5dd22ec19 2023-11-01 09:56:14,555 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x285914fa34f8cd45: from storage DS-95e4159e-826c-4234-bc1d-43be08563c4d node DatanodeRegistration(127.0.0.1:44993, datanodeUuid=4ad3621f-380f-4aed-bfb9-74cd49256923, infoPort=43041, infoSecurePort=0, ipcPort=37085, storageInfo=lv=-57;cid=testClusterID;nsid=2090193497;c=1698832428297), blocks: 127, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-01 09:56:14,555 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x285914fa34f8cd45: from storage DS-40eadba4-0f50-4bef-98ae-3a59a2575aa0 node DatanodeRegistration(127.0.0.1:44993, datanodeUuid=4ad3621f-380f-4aed-bfb9-74cd49256923, infoPort=43041, infoSecurePort=0, ipcPort=37085, storageInfo=lv=-57;cid=testClusterID;nsid=2090193497;c=1698832428297), blocks: 118, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-01 09:56:14,794 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/4876ce6718f549aebbfa194882d6b5d8 2023-11-01 09:56:14,798 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/4876ce6718f549aebbfa194882d6b5d8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/4876ce6718f549aebbfa194882d6b5d8 2023-11-01 09:56:14,802 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/4876ce6718f549aebbfa194882d6b5d8, entries=1, sequenceid=17, filesize=4.9 K 2023-11-01 09:56:14,802 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 824ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:14,803 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:14,803 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:14,804 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,804 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:14,805 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,805 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56326edc[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:14,807 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:14,807 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,808 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,808 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:14,808 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,808 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:14,808 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:14,808 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:14,809 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:14,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:14,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,809 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:14,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:14,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:14,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:14,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:14,812 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:14,812 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:14,812 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:14,812 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,812 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:14,814 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,814 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:14,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,814 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:14,815 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,816 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:14,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,818 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:14,818 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:14,918 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:14,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:14,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:14,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:14,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,924 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:14,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:14,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:14,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:14,925 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,925 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,926 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:14,926 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:14,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:14,926 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:14,926 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:14,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:14,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,927 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:14,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:14,928 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:14,928 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:14,928 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:14,928 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:14,928 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:14,928 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:14,928 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:14,928 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:15,339 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f6504949d7ab4f9cbd3346bd23e43e9c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6504949d7ab4f9cbd3346bd23e43e9c 2023-11-01 09:56:15,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:56:15,744 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/08e0cdc1d820424684b1e4962d5a254a 2023-11-01 09:56:15,748 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/08e0cdc1d820424684b1e4962d5a254a as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/08e0cdc1d820424684b1e4962d5a254a 2023-11-01 09:56:15,751 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/08e0cdc1d820424684b1e4962d5a254a, entries=1, sequenceid=21, filesize=4.9 K 2023-11-01 09:56:15,752 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 824ms, sequenceid=21, compaction requested=true 2023-11-01 09:56:15,752 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:15,752 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:15,752 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:15,752 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:15,752 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,752 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:15,752 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:15,754 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,754 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:15,755 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,755 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:15,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:15,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@359c0aaf[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:15,756 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:15,756 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,759 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,759 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:15,759 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:15,759 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:15,759 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,759 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:15,760 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:15,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:15,763 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:15,763 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:15,763 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:15,763 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,763 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:15,764 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,764 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,764 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:15,765 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:15,766 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,771 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:15,771 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:15,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:15,771 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:15,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:56:15,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:15,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:15,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:15,771 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:15,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:15,772 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,872 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:15,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:15,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:15,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:15,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,878 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:15,878 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:15,878 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:15,878 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:15,879 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,879 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,880 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,880 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:15,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:15,880 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:15,880 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,881 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,881 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:15,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:15,881 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:15,881 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:15,882 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:16,293 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231131305cc65564340862e9e7980e331ba to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231131305cc65564340862e9e7980e331ba 2023-11-01 09:56:16,698 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/0f3335d6e9424ccf84cce18f5edd47cb 2023-11-01 09:56:16,702 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/0f3335d6e9424ccf84cce18f5edd47cb as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0f3335d6e9424ccf84cce18f5edd47cb 2023-11-01 09:56:16,705 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0f3335d6e9424ccf84cce18f5edd47cb, entries=1, sequenceid=25, filesize=4.9 K 2023-11-01 09:56:16,706 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 824ms, sequenceid=25, compaction requested=true 2023-11-01 09:56:16,706 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:16,706 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:16,706 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:16,706 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:16,706 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,706 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:16,706 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:16,707 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,707 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:16,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:16,708 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,708 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:16,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:16,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:16,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:16,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:16,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@130e1c09[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:16,709 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:16,709 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,712 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:16,712 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,712 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:16,713 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:16,713 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:16,713 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,713 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:16,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:16,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:16,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:16,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:16,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:16,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:16,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:16,715 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:16,715 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:16,715 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:16,715 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,715 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:16,717 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,717 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,717 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:16,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:16,717 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,718 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,720 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,720 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:16,720 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:16,720 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:16,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:16,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:16,720 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:16,720 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,721 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,721 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,721 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:16,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:16,721 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,721 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:16,721 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,821 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:16,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:16,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:16,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:16,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,827 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:16,827 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:16,827 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:16,827 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:16,828 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,828 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,830 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:16,830 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:16,830 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,830 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:16,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,831 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,831 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:16,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:16,831 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:16,831 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:16,831 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:16,831 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:16,831 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:16,831 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:16,831 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:16,831 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:17,242 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c975d08561ed4d1d8efb5a5e4c2fd987 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c975d08561ed4d1d8efb5a5e4c2fd987 2023-11-01 09:56:17,647 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/0968487ba6394d85ad33365fb9a8c3f3 2023-11-01 09:56:17,652 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/0968487ba6394d85ad33365fb9a8c3f3 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0968487ba6394d85ad33365fb9a8c3f3 2023-11-01 09:56:17,656 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0968487ba6394d85ad33365fb9a8c3f3, entries=1, sequenceid=29, filesize=4.9 K 2023-11-01 09:56:17,656 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 825ms, sequenceid=29, compaction requested=true 2023-11-01 09:56:17,656 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:17,656 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:17,657 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:17,657 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:17,657 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,657 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:17,657 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:17,658 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:17,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,659 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:17,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:17,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:17,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:17,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:17,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51123606[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:17,660 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:17,660 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,661 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:17,661 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,661 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:17,662 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:17,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:17,664 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:17,664 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:17,664 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:17,664 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,664 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:17,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:17,667 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,667 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:17,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,668 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:17,670 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:17,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:17,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:17,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,670 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-01 09:56:17,671 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:17,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:17,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:17,671 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:17,771 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:17,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:17,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:17,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:17,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,777 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:17,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:17,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:17,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:17,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,777 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,778 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:17,778 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:17,779 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,779 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:17,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,779 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,780 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:17,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:17,780 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:17,780 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:17,780 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:17,780 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:17,780 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:17,780 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:17,780 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:17,780 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:17,791 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010320b3d9717e4e4b8cb1816f4a313a6e13 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010320b3d9717e4e4b8cb1816f4a313a6e13 2023-11-01 09:56:18,196 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/c34d5b47605c45df84ed5ce089a109e9 2023-11-01 09:56:18,200 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/c34d5b47605c45df84ed5ce089a109e9 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/c34d5b47605c45df84ed5ce089a109e9 2023-11-01 09:56:18,203 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/c34d5b47605c45df84ed5ce089a109e9, entries=1, sequenceid=33, filesize=4.9 K 2023-11-01 09:56:18,204 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 424ms, sequenceid=33, compaction requested=true 2023-11-01 09:56:18,204 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:18,204 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:18,204 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:18,204 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:18,204 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,204 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:18,204 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:18,206 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:18,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,206 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:18,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:18,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:18,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1413e676[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:18,207 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:18,207 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,211 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,211 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:18,211 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:18,211 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:18,211 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,211 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:18,212 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:18,212 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,212 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,212 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:18,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:18,214 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:18,214 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:18,214 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:18,214 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,214 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:18,215 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,215 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:18,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,215 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:18,216 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:18,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,217 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:18,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,226 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:18,226 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:18,227 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:18,226 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,226 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:18,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:18,227 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:18,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:18,327 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:18,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:18,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:18,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:18,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,333 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:18,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:18,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:18,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:18,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,333 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,334 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,334 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:18,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:18,335 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:18,335 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:18,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:18,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:18,336 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:18,336 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:18,336 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:18,747 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077d2452b94efb439fbf40edc1d3fe7d20 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509077d2452b94efb439fbf40edc1d3fe7d20 2023-11-01 09:56:19,151 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/f05abd08fdf34226bdda09795c70688e 2023-11-01 09:56:19,155 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/f05abd08fdf34226bdda09795c70688e as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/f05abd08fdf34226bdda09795c70688e 2023-11-01 09:56:19,159 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/f05abd08fdf34226bdda09795c70688e, entries=1, sequenceid=37, filesize=4.9 K 2023-11-01 09:56:19,159 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 823ms, sequenceid=37, compaction requested=true 2023-11-01 09:56:19,159 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:19,159 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:19,160 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:19,160 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,160 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:19,160 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:19,161 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,161 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:19,161 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,161 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:19,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:19,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@418f4f29[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:19,163 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:19,163 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,168 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,168 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:19,168 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:19,168 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:19,168 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,168 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:19,169 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:19,169 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,169 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:19,169 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:19,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:19,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:19,171 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:19,171 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:19,171 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:19,171 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,171 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:19,173 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,173 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:19,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,173 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:19,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:19,173 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,174 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:19,176 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:19,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:19,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:19,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:19,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:19,176 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,177 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,177 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,177 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,177 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:19,177 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:19,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:19,277 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:19,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:19,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:19,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:19,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,283 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:19,283 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:19,283 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-01 09:56:19,283 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-01 09:56:19,283 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,283 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,286 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:19,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:19,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:19,286 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,286 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-01 09:56:19,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-01 09:56:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-01 09:56:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-01 09:56:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:19,287 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:19,287 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. started... 2023-11-01 09:56:19,287 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bf7cf4be28cce55b870b7451ab8d5fef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-01 09:56:19,698 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a2973c6180504d70bc1edfed8bb54ea6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2973c6180504d70bc1edfed8bb54ea6 2023-11-01 09:56:20,105 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/e71799f5a9ba43b59ac0b50ec7c74b08 2023-11-01 09:56:20,109 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/e71799f5a9ba43b59ac0b50ec7c74b08 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/e71799f5a9ba43b59ac0b50ec7c74b08 2023-11-01 09:56:20,112 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/e71799f5a9ba43b59ac0b50ec7c74b08, entries=1, sequenceid=41, filesize=4.9 K 2023-11-01 09:56:20,113 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bf7cf4be28cce55b870b7451ab8d5fef in 826ms, sequenceid=41, compaction requested=true 2023-11-01 09:56:20,113 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:20,113 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:20,113 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-01 09:56:20,113 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-01 09:56:20,113 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,113 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-01 09:56:20,113 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-01 09:56:20,115 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,115 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:20,115 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:20,115 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-01 09:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2202ed45[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:20,116 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-01 09:56:20,116 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,117 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-01 09:56:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-01 09:56:20,117 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,118 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:20,119 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-01 09:56:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-01 09:56:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:20,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-01 09:56:20,121 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-01 09:56:20,121 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:20,121 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:20,121 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,121 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:20,124 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,124 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:20,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,124 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:20,124 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:20,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,125 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:20,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:20,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:20,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-01 09:56:20,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:20,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,128 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:20,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:20,128 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:20,129 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,129 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:20,129 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,129 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:20,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:20,129 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:20,229 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:20,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:20,231 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-01 09:56:20,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:56:20,233 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:56:20,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:56:20,234 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833180234 2023-11-01 09:56:20,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-01 09:56:20,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-01 09:56:20,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:20,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x1574c19f to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:56:20,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ac4a84e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:56:20,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:21,072 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a0a63f96e8ce426cbcfd35adc949610a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a0a63f96e8ce426cbcfd35adc949610a 2023-11-01 09:56:21,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:21,086 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:56:21,088 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:56:21,093 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:56:21,094 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:56:21,102 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3070f082dbe240339447fe78922b8731 first=Optional[r5] last=Optional[r6] 2023-11-01 09:56:21,103 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3070f082dbe240339447fe78922b8731}] 2023-11-01 09:56:21,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3070f082dbe240339447fe78922b8731 for inclusion in bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:21,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-01 09:56:21,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:56:21,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:21,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3070f082dbe240339447fe78922b8731 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g8mv33itfgjstq64p34rc4bptav86k3nops2utc4q1jrskne8qpc0fttk4f6et59/family1/3070f082dbe240339447fe78922b8731 2023-11-01 09:56:21,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g8mv33itfgjstq64p34rc4bptav86k3nops2utc4q1jrskne8qpc0fttk4f6et59/family1/3070f082dbe240339447fe78922b8731 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_ 2023-11-01 09:56:21,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g8mv33itfgjstq64p34rc4bptav86k3nops2utc4q1jrskne8qpc0fttk4f6et59/family1/3070f082dbe240339447fe78922b8731 into bf7cf4be28cce55b870b7451ab8d5fef/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_ - updating store file list. 2023-11-01 09:56:21,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_ into bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:21,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g8mv33itfgjstq64p34rc4bptav86k3nops2utc4q1jrskne8qpc0fttk4f6et59/family1/3070f082dbe240339447fe78922b8731 into bf7cf4be28cce55b870b7451ab8d5fef/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_) 2023-11-01 09:56:21,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g8mv33itfgjstq64p34rc4bptav86k3nops2utc4q1jrskne8qpc0fttk4f6et59/family1/3070f082dbe240339447fe78922b8731 2023-11-01 09:56:21,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-01 09:56:21,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-01 09:56:21,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(1912): bf7cf4be28cce55b870b7451ab8d5fef/family1 is initiating minor compaction 2023-11-01 09:56:21,122 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bf7cf4be28cce55b870b7451ab8d5fef/family1 in testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:21,122 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/3e0c223eaae541c59bd4c2c5dab2ab8a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/5d6e123f908c46f8b367b53bb79135a7, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/4876ce6718f549aebbfa194882d6b5d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/08e0cdc1d820424684b1e4962d5a254a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0f3335d6e9424ccf84cce18f5edd47cb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0968487ba6394d85ad33365fb9a8c3f3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/c34d5b47605c45df84ed5ce089a109e9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/f05abd08fdf34226bdda09795c70688e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/e71799f5a9ba43b59ac0b50ec7c74b08, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp, totalSize=49.7 K 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 3e0c223eaae541c59bd4c2c5dab2ab8a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 5d6e123f908c46f8b367b53bb79135a7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 4876ce6718f549aebbfa194882d6b5d8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 08e0cdc1d820424684b1e4962d5a254a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 0f3335d6e9424ccf84cce18f5edd47cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 0968487ba6394d85ad33365fb9a8c3f3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting c34d5b47605c45df84ed5ce089a109e9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-01 09:56:21,122 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting f05abd08fdf34226bdda09795c70688e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-01 09:56:21,123 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting e71799f5a9ba43b59ac0b50ec7c74b08, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-01 09:56:21,123 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 80a530372e4444ef87884a37f1c89710_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-01 09:56:21,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@70ddf6a7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:56:21,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:21,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:21,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c975d08561ed4d1d8efb5a5e4c2fd987 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c975d08561ed4d1d8efb5a5e4c2fd987 2023-11-01 09:56:21,129 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010320b3d9717e4e4b8cb1816f4a313a6e13 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010320b3d9717e4e4b8cb1816f4a313a6e13 2023-11-01 09:56:21,129 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-01 09:56:21,129 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-01 09:56:21,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:21,130 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:21,173 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): bf7cf4be28cce55b870b7451ab8d5fef#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:21,587 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231599422324655429397b2feb2a642684a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231599422324655429397b2feb2a642684a 2023-11-01 09:56:21,587 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/abb0adf80e184775a8f81b12c0de1163 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/abb0adf80e184775a8f81b12c0de1163 2023-11-01 09:56:21,587 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:21,591 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in bf7cf4be28cce55b870b7451ab8d5fef/family1 of bf7cf4be28cce55b870b7451ab8d5fef into abb0adf80e184775a8f81b12c0de1163(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:21,591 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:21,591 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698832581122; duration=0sec 2023-11-01 09:56:21,592 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:56:21,614 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc6ab216769445e296464ce67d58816f first=Optional[r1] last=Optional[r4] 2023-11-01 09:56:21,615 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc6ab216769445e296464ce67d58816f}] 2023-11-01 09:56:21,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc6ab216769445e296464ce67d58816f for inclusion in bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:21,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-01 09:56:21,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:56:21,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:21,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc6ab216769445e296464ce67d58816f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p54h2srjcq0fs9b8onra4hhmjkp38aih94ob8rjadmhqeaccarfv5vmm14hhit1/family1/cc6ab216769445e296464ce67d58816f 2023-11-01 09:56:21,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p54h2srjcq0fs9b8onra4hhmjkp38aih94ob8rjadmhqeaccarfv5vmm14hhit1/family1/cc6ab216769445e296464ce67d58816f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_ 2023-11-01 09:56:21,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p54h2srjcq0fs9b8onra4hhmjkp38aih94ob8rjadmhqeaccarfv5vmm14hhit1/family1/cc6ab216769445e296464ce67d58816f into bf7cf4be28cce55b870b7451ab8d5fef/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_ - updating store file list. 2023-11-01 09:56:21,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_ into bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:21,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p54h2srjcq0fs9b8onra4hhmjkp38aih94ob8rjadmhqeaccarfv5vmm14hhit1/family1/cc6ab216769445e296464ce67d58816f into bf7cf4be28cce55b870b7451ab8d5fef/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_) 2023-11-01 09:56:21,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p54h2srjcq0fs9b8onra4hhmjkp38aih94ob8rjadmhqeaccarfv5vmm14hhit1/family1/cc6ab216769445e296464ce67d58816f 2023-11-01 09:56:21,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-01 09:56:21,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-01 09:56:21,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(1912): bf7cf4be28cce55b870b7451ab8d5fef/family1 is initiating minor compaction (all files) 2023-11-01 09:56:21,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d8c97cd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:56:21,629 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bf7cf4be28cce55b870b7451ab8d5fef/family1 in testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:21,629 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/01c29c8ea338493582f5662fce258a5c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/abb0adf80e184775a8f81b12c0de1163, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp, totalSize=178.1 K 2023-11-01 09:56:21,630 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting 01c29c8ea338493582f5662fce258a5c, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878856338 2023-11-01 09:56:21,630 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting abb0adf80e184775a8f81b12c0de1163, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621256338 2023-11-01 09:56:21,630 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] compactions.Compactor(207): Compacting be7541d435e2423a999bd9940c2ef645_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965256338 2023-11-01 09:56:21,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:21,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:21,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512011caf5e3a2a27437f94efe29bd7751c73 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512011caf5e3a2a27437f94efe29bd7751c73 2023-11-01 09:56:21,635 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512054fa764053bd84e549addb5b5dd22ec19 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512054fa764053bd84e549addb5b5dd22ec19 2023-11-01 09:56:21,637 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6504949d7ab4f9cbd3346bd23e43e9c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6504949d7ab4f9cbd3346bd23e43e9c 2023-11-01 09:56:21,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231131305cc65564340862e9e7980e331ba to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231131305cc65564340862e9e7980e331ba 2023-11-01 09:56:21,638 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-01 09:56:21,638 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-01 09:56:21,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:21,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:21,646 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] throttle.PressureAwareThroughputController(145): bf7cf4be28cce55b870b7451ab8d5fef#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:21,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/3e0c223eaae541c59bd4c2c5dab2ab8a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/5d6e123f908c46f8b367b53bb79135a7, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/4876ce6718f549aebbfa194882d6b5d8, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/08e0cdc1d820424684b1e4962d5a254a, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0f3335d6e9424ccf84cce18f5edd47cb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0968487ba6394d85ad33365fb9a8c3f3, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/c34d5b47605c45df84ed5ce089a109e9, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/f05abd08fdf34226bdda09795c70688e, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/e71799f5a9ba43b59ac0b50ec7c74b08, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_] to archive 2023-11-01 09:56:21,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:21,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/3e0c223eaae541c59bd4c2c5dab2ab8a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/3e0c223eaae541c59bd4c2c5dab2ab8a 2023-11-01 09:56:21,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/5d6e123f908c46f8b367b53bb79135a7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/5d6e123f908c46f8b367b53bb79135a7 2023-11-01 09:56:21,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/4876ce6718f549aebbfa194882d6b5d8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/4876ce6718f549aebbfa194882d6b5d8 2023-11-01 09:56:21,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/08e0cdc1d820424684b1e4962d5a254a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/08e0cdc1d820424684b1e4962d5a254a 2023-11-01 09:56:21,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0f3335d6e9424ccf84cce18f5edd47cb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0f3335d6e9424ccf84cce18f5edd47cb 2023-11-01 09:56:21,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0968487ba6394d85ad33365fb9a8c3f3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/0968487ba6394d85ad33365fb9a8c3f3 2023-11-01 09:56:21,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/c34d5b47605c45df84ed5ce089a109e9 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/c34d5b47605c45df84ed5ce089a109e9 2023-11-01 09:56:21,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/f05abd08fdf34226bdda09795c70688e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/f05abd08fdf34226bdda09795c70688e 2023-11-01 09:56:21,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/e71799f5a9ba43b59ac0b50ec7c74b08 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/e71799f5a9ba43b59ac0b50ec7c74b08 2023-11-01 09:56:21,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/80a530372e4444ef87884a37f1c89710_SeqId_44_ 2023-11-01 09:56:22,482 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307327431f58a94d509a25f6b4d0e3c665 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307327431f58a94d509a25f6b4d0e3c665 2023-11-01 09:56:22,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:22,509 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0ebd259be854050b9e7f31900fbbd88 first=Optional[r00] last=Optional[r8] 2023-11-01 09:56:22,510 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0ebd259be854050b9e7f31900fbbd88}] 2023-11-01 09:56:22,512 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0ebd259be854050b9e7f31900fbbd88 for inclusion in bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-01 09:56:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last= 2023-11-01 09:56:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:22,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0ebd259be854050b9e7f31900fbbd88 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1a37jqek5hu95tk7q1j93m2mu4daol61kuqhhr99tnagat9hlaa47mgtdoflnfd5/family1/b0ebd259be854050b9e7f31900fbbd88 2023-11-01 09:56:22,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1a37jqek5hu95tk7q1j93m2mu4daol61kuqhhr99tnagat9hlaa47mgtdoflnfd5/family1/b0ebd259be854050b9e7f31900fbbd88 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/1b556d3c2a724959ac7dc6c48f932d5f_SeqId_49_ 2023-11-01 09:56:22,518 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1a37jqek5hu95tk7q1j93m2mu4daol61kuqhhr99tnagat9hlaa47mgtdoflnfd5/family1/b0ebd259be854050b9e7f31900fbbd88 into bf7cf4be28cce55b870b7451ab8d5fef/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/1b556d3c2a724959ac7dc6c48f932d5f_SeqId_49_ - updating store file list. 2023-11-01 09:56:22,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/1b556d3c2a724959ac7dc6c48f932d5f_SeqId_49_ into bf7cf4be28cce55b870b7451ab8d5fef/family1 2023-11-01 09:56:22,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1a37jqek5hu95tk7q1j93m2mu4daol61kuqhhr99tnagat9hlaa47mgtdoflnfd5/family1/b0ebd259be854050b9e7f31900fbbd88 into bf7cf4be28cce55b870b7451ab8d5fef/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/1b556d3c2a724959ac7dc6c48f932d5f_SeqId_49_) 2023-11-01 09:56:22,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1a37jqek5hu95tk7q1j93m2mu4daol61kuqhhr99tnagat9hlaa47mgtdoflnfd5/family1/b0ebd259be854050b9e7f31900fbbd88 2023-11-01 09:56:22,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:22,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:22,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2973c6180504d70bc1edfed8bb54ea6 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2973c6180504d70bc1edfed8bb54ea6 2023-11-01 09:56:22,526 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128512e6e01dc1942f3a3574bc25baa5050 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128512e6e01dc1942f3a3574bc25baa5050 2023-11-01 09:56:22,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113008ce6aefd16f41798224003c2a00ed5e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113008ce6aefd16f41798224003c2a00ed5e 2023-11-01 09:56:22,527 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-01 09:56:22,528 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-01 09:56:22,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:22,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:22,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-01 09:56:22,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-01 09:56:22,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:56:22,530 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-01 09:56:22,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2990 sec 2023-11-01 09:56:22,761 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255 (was 257), OpenFileDescriptor=650 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 136) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 172), AvailableMemoryMB=10932 (was 10828) - AvailableMemoryMB LEAK? - 2023-11-01 09:56:22,774 INFO [Listener at localhost/37085] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=255, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=170, AvailableMemoryMB=10932 2023-11-01 09:56:22,793 DEBUG [Listener at localhost/37085] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-01 09:56:22,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF6\xCD\xBE"\xC3N\x02\x94\xFD\x16-\x13P\x92\xC5\xA2"\x10N\x8F-|0gF\x80J\x92\xB0\xEAt\xE4\x9C\x86*\x10\xEC\xD4\xEA\xDB\x95\x8D2x\xFC\xF2Pts\xD8\xD2\x092\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-01 09:56:22,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-01 09:56:22,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-01 09:56:22,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-01 09:56:22,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-01 09:56:22,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-01 09:56:22,852 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:22,852 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65 empty. 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4 empty. 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec empty. 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:22,853 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:22,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-01 09:56:22,864 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/.tmp/family1/d25f72bdaa9240e8b67199f4eea783c7 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/d25f72bdaa9240e8b67199f4eea783c7 2023-11-01 09:56:22,867 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in bf7cf4be28cce55b870b7451ab8d5fef/family1 of bf7cf4be28cce55b870b7451ab8d5fef into d25f72bdaa9240e8b67199f4eea783c7(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:56:22,867 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:22,867 INFO [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698832581629; duration=1sec 2023-11-01 09:56:22,868 DEBUG [RS:0;jenkins-hbase4:40233-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-01 09:56:22,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/01c29c8ea338493582f5662fce258a5c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/abb0adf80e184775a8f81b12c0de1163, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_] to archive 2023-11-01 09:56:22,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:22,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/01c29c8ea338493582f5662fce258a5c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/01c29c8ea338493582f5662fce258a5c 2023-11-01 09:56:22,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/abb0adf80e184775a8f81b12c0de1163 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/abb0adf80e184775a8f81b12c0de1163 2023-11-01 09:56:22,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_ to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/family1/be7541d435e2423a999bd9940c2ef645_SeqId_47_ 2023-11-01 09:56:22,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-01 09:56:23,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-01 09:56:23,261 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-01 09:56:23,262 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => ffa01e260f75ac2a0ec0e96611ab19b4, NAME => 'testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF6\xCD\xBE"\xC3N\x02\x94\xFD\x16-\x13P\x92\xC5\xA2"\x10N\x8F-|0gF\x80J\x92\xB0\xEAt\xE4\x9C\x86*\x10\xEC\xD4\xEA\xDB\x95\x8D2x\xFC\xF2Pts\xD8\xD2\x092\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:56:23,263 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8d6cb8cf442ba89dc74d0fed3e135b65, NAME => 'testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF6\xCD\xBE"\xC3N\x02\x94\xFD\x16-\x13P\x92\xC5\xA2"\x10N\x8F-|0gF\x80J\x92\xB0\xEAt\xE4\x9C\x86*\x10\xEC\xD4\xEA\xDB\x95\x8D2x\xFC\xF2Pts\xD8\xD2\x092\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:56:23,263 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => f608f63b441ef25b7af7d5929c11a6ec, NAME => 'testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF6\xCD\xBE"\xC3N\x02\x94\xFD\x16-\x13P\x92\xC5\xA2"\x10N\x8F-|0gF\x80J\x92\xB0\xEAt\xE4\x9C\x86*\x10\xEC\xD4\xEA\xDB\x95\x8D2x\xFC\xF2Pts\xD8\xD2\x092\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/.tmp 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 8d6cb8cf442ba89dc74d0fed3e135b65, disabling compactions & flushes 2023-11-01 09:56:23,271 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. after waiting 0 ms 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:23,271 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:23,271 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:23,272 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing ffa01e260f75ac2a0ec0e96611ab19b4, disabling compactions & flushes 2023-11-01 09:56:23,272 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:23,272 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:23,272 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. after waiting 0 ms 2023-11-01 09:56:23,272 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:23,272 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:23,272 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:23,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-01 09:56:23,672 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:23,672 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing f608f63b441ef25b7af7d5929c11a6ec, disabling compactions & flushes 2023-11-01 09:56:23,672 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:23,672 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:23,673 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. after waiting 0 ms 2023-11-01 09:56:23,673 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:23,673 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:23,673 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:23,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-01 09:56:23,675 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832583675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832583675"}]},"ts":"1698832583675"} 2023-11-01 09:56:23,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832583675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832583675"}]},"ts":"1698832583675"} 2023-11-01 09:56:23,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698832583675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698832583675"}]},"ts":"1698832583675"} 2023-11-01 09:56:23,677 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-01 09:56:23,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-01 09:56:23,678 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832583678"}]},"ts":"1698832583678"} 2023-11-01 09:56:23,679 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-01 09:56:23,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8d6cb8cf442ba89dc74d0fed3e135b65, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f608f63b441ef25b7af7d5929c11a6ec, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ffa01e260f75ac2a0ec0e96611ab19b4, ASSIGN}] 2023-11-01 09:56:23,684 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8d6cb8cf442ba89dc74d0fed3e135b65, ASSIGN 2023-11-01 09:56:23,684 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f608f63b441ef25b7af7d5929c11a6ec, ASSIGN 2023-11-01 09:56:23,684 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ffa01e260f75ac2a0ec0e96611ab19b4, ASSIGN 2023-11-01 09:56:23,685 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f608f63b441ef25b7af7d5929c11a6ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:56:23,685 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ffa01e260f75ac2a0ec0e96611ab19b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:56:23,685 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8d6cb8cf442ba89dc74d0fed3e135b65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40233,1698832432817; forceNewPlan=false, retain=false 2023-11-01 09:56:23,836 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=f608f63b441ef25b7af7d5929c11a6ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:23,836 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=8d6cb8cf442ba89dc74d0fed3e135b65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:23,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698832583836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832583836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832583836"}]},"ts":"1698832583836"} 2023-11-01 09:56:23,836 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ffa01e260f75ac2a0ec0e96611ab19b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:23,837 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832583836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832583836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832583836"}]},"ts":"1698832583836"} 2023-11-01 09:56:23,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832583836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698832583836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698832583836"}]},"ts":"1698832583836"} 2023-11-01 09:56:23,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure f608f63b441ef25b7af7d5929c11a6ec, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:56:23,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 8d6cb8cf442ba89dc74d0fed3e135b65, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:56:23,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure ffa01e260f75ac2a0ec0e96611ab19b4, server=jenkins-hbase4.apache.org,40233,1698832432817}] 2023-11-01 09:56:23,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-01 09:56:23,989 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:23,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:23,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f608f63b441ef25b7af7d5929c11a6ec, NAME => 'testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.', STARTKEY => '1', ENDKEY => '2'} 2023-11-01 09:56:23,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:23,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:23,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:23,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:24,014 INFO [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:24,015 DEBUG [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1 2023-11-01 09:56:24,015 DEBUG [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1 2023-11-01 09:56:24,015 INFO [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f608f63b441ef25b7af7d5929c11a6ec columnFamilyName family1 2023-11-01 09:56:24,016 INFO [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] regionserver.HStore(310): Store=f608f63b441ef25b7af7d5929c11a6ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:24,017 INFO [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:24,018 DEBUG [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2 2023-11-01 09:56:24,018 DEBUG [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2 2023-11-01 09:56:24,018 INFO [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f608f63b441ef25b7af7d5929c11a6ec columnFamilyName family2 2023-11-01 09:56:24,019 INFO [StoreOpener-f608f63b441ef25b7af7d5929c11a6ec-1] regionserver.HStore(310): Store=f608f63b441ef25b7af7d5929c11a6ec/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:24,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:24,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:24,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:56:24,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:24,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:56:24,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f608f63b441ef25b7af7d5929c11a6ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61476595, jitterRate=-0.08392734825611115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:56:24,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:24,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec., pid=120, masterSystemTime=1698832583989 2023-11-01 09:56:24,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:24,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:24,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:24,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d6cb8cf442ba89dc74d0fed3e135b65, NAME => 'testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.', STARTKEY => '', ENDKEY => '1'} 2023-11-01 09:56:24,026 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=f608f63b441ef25b7af7d5929c11a6ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:24,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,026 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698832584026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832584026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832584026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832584026"}]},"ts":"1698832584026"} 2023-11-01 09:56:24,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:24,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=118 2023-11-01 09:56:24,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure f608f63b441ef25b7af7d5929c11a6ec, server=jenkins-hbase4.apache.org,40233,1698832432817 in 189 msec 2023-11-01 09:56:24,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f608f63b441ef25b7af7d5929c11a6ec, ASSIGN in 346 msec 2023-11-01 09:56:24,046 INFO [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,047 DEBUG [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1 2023-11-01 09:56:24,047 DEBUG [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1 2023-11-01 09:56:24,047 INFO [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d6cb8cf442ba89dc74d0fed3e135b65 columnFamilyName family1 2023-11-01 09:56:24,048 INFO [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] regionserver.HStore(310): Store=8d6cb8cf442ba89dc74d0fed3e135b65/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:24,048 INFO [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,049 DEBUG [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2 2023-11-01 09:56:24,049 DEBUG [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2 2023-11-01 09:56:24,049 INFO [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d6cb8cf442ba89dc74d0fed3e135b65 columnFamilyName family2 2023-11-01 09:56:24,050 INFO [StoreOpener-8d6cb8cf442ba89dc74d0fed3e135b65-1] regionserver.HStore(310): Store=8d6cb8cf442ba89dc74d0fed3e135b65/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:24,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:56:24,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:56:24,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d6cb8cf442ba89dc74d0fed3e135b65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70273900, jitterRate=0.04716271162033081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:56:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:24,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65., pid=121, masterSystemTime=1698832583989 2023-11-01 09:56:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:24,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:24,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ffa01e260f75ac2a0ec0e96611ab19b4, NAME => 'testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.', STARTKEY => '2', ENDKEY => ''} 2023-11-01 09:56:24,056 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=8d6cb8cf442ba89dc74d0fed3e135b65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-01 09:56:24,056 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832584056"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832584056"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832584056"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832584056"}]},"ts":"1698832584056"} 2023-11-01 09:56:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-11-01 09:56:24,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 8d6cb8cf442ba89dc74d0fed3e135b65, server=jenkins-hbase4.apache.org,40233,1698832432817 in 219 msec 2023-11-01 09:56:24,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8d6cb8cf442ba89dc74d0fed3e135b65, ASSIGN in 376 msec 2023-11-01 09:56:24,076 INFO [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,077 DEBUG [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1 2023-11-01 09:56:24,077 DEBUG [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1 2023-11-01 09:56:24,077 INFO [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffa01e260f75ac2a0ec0e96611ab19b4 columnFamilyName family1 2023-11-01 09:56:24,078 INFO [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] regionserver.HStore(310): Store=ffa01e260f75ac2a0ec0e96611ab19b4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:24,078 INFO [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,079 DEBUG [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2 2023-11-01 09:56:24,079 DEBUG [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2 2023-11-01 09:56:24,079 INFO [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffa01e260f75ac2a0ec0e96611ab19b4 columnFamilyName family2 2023-11-01 09:56:24,080 INFO [StoreOpener-ffa01e260f75ac2a0ec0e96611ab19b4-1] regionserver.HStore(310): Store=ffa01e260f75ac2a0ec0e96611ab19b4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-01 09:56:24,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-01 09:56:24,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:24,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-01 09:56:24,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ffa01e260f75ac2a0ec0e96611ab19b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64401211, jitterRate=-0.04034717381000519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-01 09:56:24,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:24,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4., pid=122, masterSystemTime=1698832583989 2023-11-01 09:56:24,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:24,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:24,086 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ffa01e260f75ac2a0ec0e96611ab19b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:24,086 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698832584086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698832584086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698832584086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698832584086"}]},"ts":"1698832584086"} 2023-11-01 09:56:24,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-01 09:56:24,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure ffa01e260f75ac2a0ec0e96611ab19b4, server=jenkins-hbase4.apache.org,40233,1698832432817 in 248 msec 2023-11-01 09:56:24,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-01 09:56:24,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ffa01e260f75ac2a0ec0e96611ab19b4, ASSIGN in 407 msec 2023-11-01 09:56:24,090 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-01 09:56:24,090 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698832584090"}]},"ts":"1698832584090"} 2023-11-01 09:56:24,091 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-01 09:56:24,093 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-01 09:56:24,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2450 sec 2023-11-01 09:56:24,522 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-01 09:56:24,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-01 09:56:24,956 INFO [Listener at localhost/37085] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-01 09:56:24,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:24,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:24,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:24,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:24,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-01 09:56:24,966 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-01 09:56:24,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:24,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-01 09:56:24,966 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-01 09:56:24,967 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:24,967 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:24,968 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:24,968 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:24,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:24,969 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:24,969 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:24,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:24,970 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-01 09:56:24,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-01 09:56:24,970 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-01 09:56:24,970 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:24,970 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-01 09:56:24,970 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:24,970 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. started... 2023-11-01 09:56:24,970 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:56:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:24,971 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6cb8cf442ba89dc74d0fed3e135b65 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:56:24,971 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:24,971 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. started... 2023-11-01 09:56:24,971 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. started... 2023-11-01 09:56:24,973 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f608f63b441ef25b7af7d5929c11a6ec 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:56:24,973 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffa01e260f75ac2a0ec0e96611ab19b4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-01 09:56:25,021 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101ffd8ffe8a78342aa91a61dfa013d151b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101ffd8ffe8a78342aa91a61dfa013d151b 2023-11-01 09:56:25,021 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110166e702dca87549f689c411ac2187ac8c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110166e702dca87549f689c411ac2187ac8c 2023-11-01 09:56:25,043 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/459db717ea5b4f948e923d05383c76eb 2023-11-01 09:56:25,088 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101e7a90d0b8944465cb32668f9eab5eb78 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231101e7a90d0b8944465cb32668f9eab5eb78 2023-11-01 09:56:25,423 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110144729868ae714aa98d14bd7c1c3f6b25 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110144729868ae714aa98d14bd7c1c3f6b25 2023-11-01 09:56:25,437 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/7cb3b4cd84454abc8f2e0a87e22958c5 2023-11-01 09:56:25,443 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/e3c2689d19d44f43a10a7d3513f6cfe1 2023-11-01 09:56:25,467 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311010fe15355295d4d5d92f858e13fabe57f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311010fe15355295d4d5d92f858e13fabe57f 2023-11-01 09:56:25,471 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/e2c566b1840c4d4c8a8a5ab3281bc562 2023-11-01 09:56:25,474 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/7cb3b4cd84454abc8f2e0a87e22958c5 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/7cb3b4cd84454abc8f2e0a87e22958c5 2023-11-01 09:56:25,494 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/fd7b7527d42c4ed6b1b85b2c7f595837 2023-11-01 09:56:25,498 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/459db717ea5b4f948e923d05383c76eb as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/459db717ea5b4f948e923d05383c76eb 2023-11-01 09:56:25,498 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/7cb3b4cd84454abc8f2e0a87e22958c5, entries=4, sequenceid=5, filesize=5.5 K 2023-11-01 09:56:25,499 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/e2c566b1840c4d4c8a8a5ab3281bc562 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/e2c566b1840c4d4c8a8a5ab3281bc562 2023-11-01 09:56:25,502 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/e2c566b1840c4d4c8a8a5ab3281bc562, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:56:25,503 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ffa01e260f75ac2a0ec0e96611ab19b4 in 531ms, sequenceid=5, compaction requested=false 2023-11-01 09:56:25,504 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:25,504 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:25,504 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:25,521 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/459db717ea5b4f948e923d05383c76eb, entries=4, sequenceid=5, filesize=5.5 K 2023-11-01 09:56:25,521 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/fd7b7527d42c4ed6b1b85b2c7f595837 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/fd7b7527d42c4ed6b1b85b2c7f595837 2023-11-01 09:56:25,524 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/fd7b7527d42c4ed6b1b85b2c7f595837, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:56:25,525 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8d6cb8cf442ba89dc74d0fed3e135b65 in 554ms, sequenceid=5, compaction requested=false 2023-11-01 09:56:25,525 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:25,525 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:25,888 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101f2302da46e494bfda1e373c3c49b44cd to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231101f2302da46e494bfda1e373c3c49b44cd 2023-11-01 09:56:26,292 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/4fed014a0daf4e4ea14609c80674544b 2023-11-01 09:56:26,296 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/e3c2689d19d44f43a10a7d3513f6cfe1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/e3c2689d19d44f43a10a7d3513f6cfe1 2023-11-01 09:56:26,320 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/e3c2689d19d44f43a10a7d3513f6cfe1, entries=4, sequenceid=5, filesize=5.5 K 2023-11-01 09:56:26,321 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/4fed014a0daf4e4ea14609c80674544b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/4fed014a0daf4e4ea14609c80674544b 2023-11-01 09:56:26,324 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/4fed014a0daf4e4ea14609c80674544b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-01 09:56:26,325 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f608f63b441ef25b7af7d5929c11a6ec in 1352ms, sequenceid=5, compaction requested=false 2023-11-01 09:56:26,325 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:26,325 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:26,325 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:26,325 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:26,325 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,326 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-01 09:56:26,326 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-01 09:56:26,334 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,335 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:26,335 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,335 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:26,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-01 09:56:26,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62e05d05[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:26,337 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-01 09:56:26,337 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,338 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-01 09:56:26,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-01 09:56:26,338 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:26,338 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,338 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:26,339 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-01 09:56:26,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:26,339 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-01 09:56:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:26,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-01 09:56:26,342 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-01 09:56:26,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:26,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:26,342 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-01 09:56:26,342 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:26,344 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,344 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,344 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:26,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:26,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:26,344 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:26,346 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:26,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:26,349 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:26,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-01 09:56:26,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:26,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-01 09:56:26,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:26,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:26,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:26,349 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,350 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,350 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:26,350 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,350 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:26,350 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:26,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:26,450 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:26,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:26,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:26,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:26,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:26,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:26,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:26,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-01 09:56:26,456 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-01 09:56:26,456 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:26,457 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-01 09:56:26,457 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-01 09:56:26,457 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,457 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:26,458 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,458 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:26,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:26,459 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:26,459 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:26,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:26,459 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-01 09:56:26,460 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-01 09:56:26,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-01 09:56:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-01 09:56:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-01 09:56:26,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:26,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:26,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. started... 2023-11-01 09:56:26,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. started... 2023-11-01 09:56:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:56:26,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:26,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:26,460 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f608f63b441ef25b7af7d5929c11a6ec 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:56:26,460 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6cb8cf442ba89dc74d0fed3e135b65 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:56:26,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. started... 2023-11-01 09:56:26,461 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffa01e260f75ac2a0ec0e96611ab19b4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-01 09:56:26,505 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101aec1786e855d425eb4147ed9b0e592b0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101aec1786e855d425eb4147ed9b0e592b0 2023-11-01 09:56:26,919 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/3d11f70e6be942cfb4241324f82e9111 2023-11-01 09:56:26,920 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101e37d35af6e214ce589e158f029ca28e3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101e37d35af6e214ce589e158f029ca28e3 2023-11-01 09:56:26,920 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101782c2a5d9bb14d1e9b59dc5646c70371 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101782c2a5d9bb14d1e9b59dc5646c70371 2023-11-01 09:56:26,935 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/2f89b8deb35447019d4de49e16e1c3ab 2023-11-01 09:56:26,940 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/f3e506f55fb044689df8cc748ea0d18d 2023-11-01 09:56:26,972 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101c64e712d281944a680cbb0b819f5f700 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231101c64e712d281944a680cbb0b819f5f700 2023-11-01 09:56:26,976 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/6c13884d78dc47ada34eace0594c94df 2023-11-01 09:56:26,978 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101d1a87252baa8484b8dda2389ec0fbf6e to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231101d1a87252baa8484b8dda2389ec0fbf6e 2023-11-01 09:56:26,980 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/f3e506f55fb044689df8cc748ea0d18d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/f3e506f55fb044689df8cc748ea0d18d 2023-11-01 09:56:26,986 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/d1356e2d7c9944a892c0f9eb0238e242 2023-11-01 09:56:26,989 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/2f89b8deb35447019d4de49e16e1c3ab as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2f89b8deb35447019d4de49e16e1c3ab 2023-11-01 09:56:27,008 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/f3e506f55fb044689df8cc748ea0d18d, entries=4, sequenceid=9, filesize=5.5 K 2023-11-01 09:56:27,009 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/6c13884d78dc47ada34eace0594c94df as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/6c13884d78dc47ada34eace0594c94df 2023-11-01 09:56:27,012 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2f89b8deb35447019d4de49e16e1c3ab, entries=4, sequenceid=9, filesize=5.5 K 2023-11-01 09:56:27,012 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/6c13884d78dc47ada34eace0594c94df, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:56:27,013 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/d1356e2d7c9944a892c0f9eb0238e242 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/d1356e2d7c9944a892c0f9eb0238e242 2023-11-01 09:56:27,013 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f608f63b441ef25b7af7d5929c11a6ec in 553ms, sequenceid=9, compaction requested=false 2023-11-01 09:56:27,013 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:27,013 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:27,013 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:27,015 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/d1356e2d7c9944a892c0f9eb0238e242, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:56:27,016 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ffa01e260f75ac2a0ec0e96611ab19b4 in 555ms, sequenceid=9, compaction requested=false 2023-11-01 09:56:27,016 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:27,016 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:27,363 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110158924058b2314ff595f3fed7fd0bcd06 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110158924058b2314ff595f3fed7fd0bcd06 2023-11-01 09:56:27,767 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/cadf9c0ae8d548038efa1f6dedb7ecf7 2023-11-01 09:56:27,772 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/3d11f70e6be942cfb4241324f82e9111 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/3d11f70e6be942cfb4241324f82e9111 2023-11-01 09:56:27,795 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/3d11f70e6be942cfb4241324f82e9111, entries=4, sequenceid=9, filesize=5.5 K 2023-11-01 09:56:27,796 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/cadf9c0ae8d548038efa1f6dedb7ecf7 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/cadf9c0ae8d548038efa1f6dedb7ecf7 2023-11-01 09:56:27,800 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/cadf9c0ae8d548038efa1f6dedb7ecf7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-01 09:56:27,800 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8d6cb8cf442ba89dc74d0fed3e135b65 in 1340ms, sequenceid=9, compaction requested=false 2023-11-01 09:56:27,800 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:27,801 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:27,801 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:27,801 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:27,801 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,801 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-01 09:56:27,801 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-01 09:56:27,802 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,802 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:27,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:27,803 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:27,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-01 09:56:27,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69cb3779[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:27,804 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-01 09:56:27,804 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,805 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-01 09:56:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-01 09:56:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:27,805 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,806 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:27,807 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,807 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-01 09:56:27,807 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:27,807 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-01 09:56:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:27,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-01 09:56:27,810 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-01 09:56:27,810 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:27,810 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:27,810 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-01 09:56:27,810 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:27,811 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,811 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,811 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:27,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:27,812 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:27,813 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:27,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-01 09:56:27,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:27,815 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:27,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:27,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-01 09:56:27,815 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:27,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:27,816 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:27,816 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,916 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:27,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:27,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:27,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:27,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-01 09:56:27,922 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-01 09:56:27,922 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:27,922 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-01 09:56:27,922 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-01 09:56:27,923 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,923 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:27,924 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:27,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:27,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:27,924 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:27,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:27,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-01 09:56:27,925 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-01 09:56:27,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-01 09:56:27,925 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-01 09:56:27,925 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:27,925 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-01 09:56:27,926 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:27,926 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:27,926 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:27,926 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. started... 2023-11-01 09:56:27,926 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:56:27,926 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:27,926 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. started... 2023-11-01 09:56:27,926 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. started... 2023-11-01 09:56:27,926 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6cb8cf442ba89dc74d0fed3e135b65 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:56:27,926 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f608f63b441ef25b7af7d5929c11a6ec 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:56:27,926 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffa01e260f75ac2a0ec0e96611ab19b4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-01 09:56:27,970 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311018609577d10584d53a58752a606f5d287 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311018609577d10584d53a58752a606f5d287 2023-11-01 09:56:27,973 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101d2e22a2e15cd4dc9846a0043d3fbeded to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101d2e22a2e15cd4dc9846a0043d3fbeded 2023-11-01 09:56:27,994 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/d511ef1d403642abbda09ff4af014d50 2023-11-01 09:56:28,028 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110123fbc7e2a5a0468e9506cc56a2ffde0c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110123fbc7e2a5a0468e9506cc56a2ffde0c 2023-11-01 09:56:28,368 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101a76cbd3cc6384db0b336ecd63eb3c047 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101a76cbd3cc6384db0b336ecd63eb3c047 2023-11-01 09:56:28,384 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/adac92b32e3740bfaed430f9907659dd 2023-11-01 09:56:28,418 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101911992939d664943ad61fba81a470eb1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231101911992939d664943ad61fba81a470eb1 2023-11-01 09:56:28,426 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/00ecb6e8c8b6463bab478455fca4e15c 2023-11-01 09:56:28,430 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/adac92b32e3740bfaed430f9907659dd as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/adac92b32e3740bfaed430f9907659dd 2023-11-01 09:56:28,432 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/59690723d5eb494f83bbb5afbf5b4cae 2023-11-01 09:56:28,437 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/d511ef1d403642abbda09ff4af014d50 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/d511ef1d403642abbda09ff4af014d50 2023-11-01 09:56:28,454 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/adac92b32e3740bfaed430f9907659dd, entries=4, sequenceid=13, filesize=5.5 K 2023-11-01 09:56:28,455 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/00ecb6e8c8b6463bab478455fca4e15c as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/00ecb6e8c8b6463bab478455fca4e15c 2023-11-01 09:56:28,459 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/00ecb6e8c8b6463bab478455fca4e15c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:56:28,460 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8d6cb8cf442ba89dc74d0fed3e135b65 in 534ms, sequenceid=13, compaction requested=true 2023-11-01 09:56:28,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:28,460 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:28,466 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/d511ef1d403642abbda09ff4af014d50, entries=4, sequenceid=13, filesize=5.5 K 2023-11-01 09:56:28,467 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/59690723d5eb494f83bbb5afbf5b4cae as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/59690723d5eb494f83bbb5afbf5b4cae 2023-11-01 09:56:28,470 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/59690723d5eb494f83bbb5afbf5b4cae, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:56:28,470 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ffa01e260f75ac2a0ec0e96611ab19b4 in 544ms, sequenceid=13, compaction requested=true 2023-11-01 09:56:28,470 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:28,471 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:28,471 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:28,790 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/70d19f87dc2b473f9ade9420be55390b 2023-11-01 09:56:29,222 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311016e4f9b0b754248b4b46e74cc76e447d3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311016e4f9b0b754248b4b46e74cc76e447d3 2023-11-01 09:56:29,531 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-01 09:56:29,627 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/fd243d42f0e04d00b661bf0e8cf93bac 2023-11-01 09:56:29,631 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/70d19f87dc2b473f9ade9420be55390b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/70d19f87dc2b473f9ade9420be55390b 2023-11-01 09:56:29,654 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/70d19f87dc2b473f9ade9420be55390b, entries=4, sequenceid=13, filesize=5.5 K 2023-11-01 09:56:29,654 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/fd243d42f0e04d00b661bf0e8cf93bac as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/fd243d42f0e04d00b661bf0e8cf93bac 2023-11-01 09:56:29,658 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/fd243d42f0e04d00b661bf0e8cf93bac, entries=2, sequenceid=13, filesize=5.1 K 2023-11-01 09:56:29,658 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f608f63b441ef25b7af7d5929c11a6ec in 1732ms, sequenceid=13, compaction requested=true 2023-11-01 09:56:29,659 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:29,659 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-01 09:56:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-01 09:56:29,660 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,660 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:29,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:29,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,661 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:29,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:29,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:29,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:29,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:29,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-01 09:56:29,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5286db6e[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:29,662 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-01 09:56:29,662 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,663 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-01 09:56:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-01 09:56:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:29,663 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,663 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:29,664 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-01 09:56:29,664 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,664 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:29,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,664 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-01 09:56:29,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:29,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:29,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-01 09:56:29,667 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-01 09:56:29,667 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:29,667 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:29,667 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-01 09:56:29,667 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:29,669 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,669 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:29,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,669 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:29,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:29,670 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:29,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:29,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:29,671 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:29,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:29,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:29,673 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:29,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:29,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:29,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:29,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-01 09:56:29,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:29,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-01 09:56:29,673 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:29,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:29,674 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,674 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:29,674 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:29,674 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:29,674 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,774 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:29,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:29,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:29,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:29,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. with WAL disabled. Data may be lost in the event of a crash. 2023-11-01 09:56:29,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:29,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:29,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-01 09:56:29,780 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-01 09:56:29,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:29,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-01 09:56:29,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-01 09:56:29,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,781 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:29,786 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:29,786 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:29,786 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:29,786 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:29,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:29,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-01 09:56:29,787 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-01 09:56:29,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-01 09:56:29,787 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-01 09:56:29,787 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:29,787 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-01 09:56:29,787 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:29,788 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:56:29,788 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:29,788 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:29,788 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. started... 2023-11-01 09:56:29,788 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:29,788 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. started... 2023-11-01 09:56:29,788 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. started... 2023-11-01 09:56:29,788 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6cb8cf442ba89dc74d0fed3e135b65 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:56:29,788 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffa01e260f75ac2a0ec0e96611ab19b4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:56:29,788 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f608f63b441ef25b7af7d5929c11a6ec 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-01 09:56:29,828 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101313aae45d2b04977a788eff42c17efa4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101313aae45d2b04977a788eff42c17efa4 2023-11-01 09:56:29,841 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/dbf9ee4393a54448ad5b8acd653e330d 2023-11-01 09:56:30,235 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101f0d5f82b3eaf4d6d8276e63e483f3a2b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101f0d5f82b3eaf4d6d8276e63e483f3a2b 2023-11-01 09:56:30,243 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101a01ec03857be40d5a4f92874cdb0b62a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101a01ec03857be40d5a4f92874cdb0b62a 2023-11-01 09:56:30,249 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/509bb258d4dc44cc8fe955eb891504b1 2023-11-01 09:56:30,271 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110149121787e1c54449909aa2f7052fda6d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110149121787e1c54449909aa2f7052fda6d 2023-11-01 09:56:30,665 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/1a882b9cf1c5481a84a7e96731eed52d 2023-11-01 09:56:30,676 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/131c8ea7250a4c39b6868d34e1f8ff36 2023-11-01 09:56:30,680 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/dbf9ee4393a54448ad5b8acd653e330d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/dbf9ee4393a54448ad5b8acd653e330d 2023-11-01 09:56:30,681 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231101b9d9a7c77f0f46b7b26745a96629f37d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231101b9d9a7c77f0f46b7b26745a96629f37d 2023-11-01 09:56:30,686 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/e57e1d98564c4d26a2e1e2c150d27b19 2023-11-01 09:56:30,689 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/509bb258d4dc44cc8fe955eb891504b1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/509bb258d4dc44cc8fe955eb891504b1 2023-11-01 09:56:30,712 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/509bb258d4dc44cc8fe955eb891504b1, entries=4, sequenceid=17, filesize=5.5 K 2023-11-01 09:56:30,713 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/e57e1d98564c4d26a2e1e2c150d27b19 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/e57e1d98564c4d26a2e1e2c150d27b19 2023-11-01 09:56:30,716 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/dbf9ee4393a54448ad5b8acd653e330d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-01 09:56:30,716 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/e57e1d98564c4d26a2e1e2c150d27b19, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:56:30,717 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/131c8ea7250a4c39b6868d34e1f8ff36 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/131c8ea7250a4c39b6868d34e1f8ff36 2023-11-01 09:56:30,717 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f608f63b441ef25b7af7d5929c11a6ec in 929ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:30,717 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:30,717 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:30,717 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:30,721 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/131c8ea7250a4c39b6868d34e1f8ff36, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:56:30,722 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8d6cb8cf442ba89dc74d0fed3e135b65 in 934ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:30,722 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:30,722 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:30,722 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:31,102 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311011b0dd1cddd344a61b1f2fdd01093c0c7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311011b0dd1cddd344a61b1f2fdd01093c0c7 2023-11-01 09:56:31,507 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/1e6f5b7fbb774c88acec856ff47d8aa1 2023-11-01 09:56:31,511 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/1a882b9cf1c5481a84a7e96731eed52d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/1a882b9cf1c5481a84a7e96731eed52d 2023-11-01 09:56:31,534 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/1a882b9cf1c5481a84a7e96731eed52d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-01 09:56:31,535 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/1e6f5b7fbb774c88acec856ff47d8aa1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1e6f5b7fbb774c88acec856ff47d8aa1 2023-11-01 09:56:31,538 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1e6f5b7fbb774c88acec856ff47d8aa1, entries=2, sequenceid=17, filesize=5.1 K 2023-11-01 09:56:31,539 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ffa01e260f75ac2a0ec0e96611ab19b4 in 1751ms, sequenceid=17, compaction requested=true 2023-11-01 09:56:31,539 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:31,539 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-01 09:56:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-01 09:56:31,541 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,541 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:31,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-01 09:56:31,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@675b7cbe[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:31,543 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-01 09:56:31,543 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,544 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,544 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-01 09:56:31,544 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-01 09:56:31,544 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:31,545 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,545 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:31,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-01 09:56:31,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:31,546 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,546 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-01 09:56:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:31,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-01 09:56:31,548 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-01 09:56:31,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:31,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:31,548 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-01 09:56:31,548 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:31,550 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,550 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:31,550 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:31,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:31,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:31,550 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,551 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:31,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-01 09:56:31,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:31,557 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,558 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:31,558 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,558 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:31,558 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:31,557 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:31,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:31,658 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:31,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:31,668 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:31,676 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:31,684 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:31,685 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:31,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-01 09:56:31,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-01 09:56:31,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-01 09:56:31,769 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-01 09:56:31,769 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:31,769 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-01 09:56:31,769 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-01 09:56:31,769 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,769 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:31,770 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:31,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:31,771 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:31,771 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:31,771 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-01 09:56:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:31,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-01 09:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:31,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-01 09:56:31,772 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-01 09:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-01 09:56:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-01 09:56:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-01 09:56:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-01 09:56:31,772 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-01 09:56:31,772 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:31,772 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:31,773 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. started... 2023-11-01 09:56:31,772 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-01 09:56:31,772 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. started... 2023-11-01 09:56:31,773 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing ffa01e260f75ac2a0ec0e96611ab19b4 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:56:31,773 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. started... 2023-11-01 09:56:31,773 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6cb8cf442ba89dc74d0fed3e135b65 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:56:31,773 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f608f63b441ef25b7af7d5929c11a6ec 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-01 09:56:31,813 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/2e28c3778c634a4380773f7210f768b0 2023-11-01 09:56:31,822 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/de96d77ddbc44df081ee902c1d1afa31 2023-11-01 09:56:31,841 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e28c3778c634a4380773f7210f768b0 2023-11-01 09:56:31,850 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de96d77ddbc44df081ee902c1d1afa31 2023-11-01 09:56:31,865 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/5004e3218d834aa789f9682a1a549989 2023-11-01 09:56:31,869 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5004e3218d834aa789f9682a1a549989 2023-11-01 09:56:31,869 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/2e28c3778c634a4380773f7210f768b0 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2e28c3778c634a4380773f7210f768b0 2023-11-01 09:56:31,899 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e28c3778c634a4380773f7210f768b0 2023-11-01 09:56:31,900 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2e28c3778c634a4380773f7210f768b0, entries=3, sequenceid=23, filesize=5.2 K 2023-11-01 09:56:31,900 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/5004e3218d834aa789f9682a1a549989 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/5004e3218d834aa789f9682a1a549989 2023-11-01 09:56:31,904 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5004e3218d834aa789f9682a1a549989 2023-11-01 09:56:31,904 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/5004e3218d834aa789f9682a1a549989, entries=1, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:31,904 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ffa01e260f75ac2a0ec0e96611ab19b4 in 131ms, sequenceid=23, compaction requested=true 2023-11-01 09:56:31,904 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:31,905 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:31,905 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-01 09:56:32,213 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/64f99fb8d78a48bfaa55285121fa39d1 2023-11-01 09:56:32,237 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64f99fb8d78a48bfaa55285121fa39d1 2023-11-01 09:56:32,265 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/3fc7e65b68c2417abbddeca4cf623ef8 2023-11-01 09:56:32,268 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fc7e65b68c2417abbddeca4cf623ef8 2023-11-01 09:56:32,269 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/de96d77ddbc44df081ee902c1d1afa31 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/de96d77ddbc44df081ee902c1d1afa31 2023-11-01 09:56:32,302 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de96d77ddbc44df081ee902c1d1afa31 2023-11-01 09:56:32,302 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/de96d77ddbc44df081ee902c1d1afa31, entries=3, sequenceid=23, filesize=5.2 K 2023-11-01 09:56:32,303 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/3fc7e65b68c2417abbddeca4cf623ef8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/3fc7e65b68c2417abbddeca4cf623ef8 2023-11-01 09:56:32,307 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fc7e65b68c2417abbddeca4cf623ef8 2023-11-01 09:56:32,307 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/3fc7e65b68c2417abbddeca4cf623ef8, entries=1, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:32,307 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8d6cb8cf442ba89dc74d0fed3e135b65 in 534ms, sequenceid=23, compaction requested=true 2023-11-01 09:56:32,308 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:32,308 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:32,308 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-01 09:56:32,647 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/06a08fc18f7749c78b6226f067e54f0d 2023-11-01 09:56:32,651 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06a08fc18f7749c78b6226f067e54f0d 2023-11-01 09:56:32,652 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/64f99fb8d78a48bfaa55285121fa39d1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/64f99fb8d78a48bfaa55285121fa39d1 2023-11-01 09:56:32,674 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64f99fb8d78a48bfaa55285121fa39d1 2023-11-01 09:56:32,674 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/64f99fb8d78a48bfaa55285121fa39d1, entries=3, sequenceid=23, filesize=5.2 K 2023-11-01 09:56:32,675 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/06a08fc18f7749c78b6226f067e54f0d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/06a08fc18f7749c78b6226f067e54f0d 2023-11-01 09:56:32,679 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06a08fc18f7749c78b6226f067e54f0d 2023-11-01 09:56:32,679 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/06a08fc18f7749c78b6226f067e54f0d, entries=1, sequenceid=23, filesize=5.0 K 2023-11-01 09:56:32,679 INFO [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f608f63b441ef25b7af7d5929c11a6ec in 906ms, sequenceid=23, compaction requested=true 2023-11-01 09:56:32,679 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:32,680 DEBUG [rs(jenkins-hbase4.apache.org,40233,1698832432817)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:32,680 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-01 09:56:32,680 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-01 09:56:32,680 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,680 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-01 09:56:32,680 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-01 09:56:32,681 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,681 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:32,682 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,682 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-01 09:56:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:32,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40233,1698832432817' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-01 09:56:32,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b31d25[Count = 0] remaining members to acquire global barrier 2023-11-01 09:56:32,683 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-01 09:56:32,683 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,684 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,684 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-01 09:56:32,684 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-01 09:56:32,684 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,684 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-01 09:56:32,684 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40233,1698832432817' in zk 2023-11-01 09:56:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-01 09:56:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:32,687 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,687 DEBUG [member: 'jenkins-hbase4.apache.org,40233,1698832432817' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-01 09:56:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40233,1698832432817': 2023-11-01 09:56:32,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40233,1698832432817' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-01 09:56:32,689 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-01 09:56:32,689 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-01 09:56:32,689 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-01 09:56:32,689 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-01 09:56:32,689 INFO [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-01 09:56:32,691 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,691 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-01 09:56:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-01 09:56:32,691 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-01 09:56:32,691 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-01 09:56:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:32,692 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-01 09:56:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-01 09:56:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-01 09:56:32,695 DEBUG [(jenkins-hbase4.apache.org,41153,1698832431566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-01 09:56:32,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-01 09:56:32,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-01 09:56:32,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-01 09:56:32,695 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-01 09:56:32,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-01 09:56:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-01 09:56:32,795 DEBUG [Listener at localhost/37085] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-01 09:56:32,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41153] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-01 09:56:32,797 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:32,797 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 8d6cb8cf442ba89dc74d0fed3e135b65/family1 is initiating major compaction (all files) 2023-11-01 09:56:32,797 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:32,797 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:32,797 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 8d6cb8cf442ba89dc74d0fed3e135b65/family1 in testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:32,797 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/459db717ea5b4f948e923d05383c76eb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/3d11f70e6be942cfb4241324f82e9111, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/adac92b32e3740bfaed430f9907659dd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/dbf9ee4393a54448ad5b8acd653e330d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/de96d77ddbc44df081ee902c1d1afa31] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp, totalSize=27.1 K 2023-11-01 09:56:32,798 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 459db717ea5b4f948e923d05383c76eb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832584962 2023-11-01 09:56:32,798 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 3d11f70e6be942cfb4241324f82e9111, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832586452 2023-11-01 09:56:32,799 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting adac92b32e3740bfaed430f9907659dd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832587918 2023-11-01 09:56:32,799 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting dbf9ee4393a54448ad5b8acd653e330d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832589776 2023-11-01 09:56:32,799 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting de96d77ddbc44df081ee902c1d1afa31, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:32,808 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 8d6cb8cf442ba89dc74d0fed3e135b65#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:32,852 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del 2023-11-01 09:56:32,853 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del 2023-11-01 09:56:32,903 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:56:32,903 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x199689fb to 127.0.0.1:49762 2023-11-01 09:56:32,903 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:32,903 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:56:32,903 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1574c19f to 127.0.0.1:49762 2023-11-01 09:56:32,903 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:32,938 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20a49e3c04274503887129c832e54f4b 2023-11-01 09:56:32,939 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family1/20a49e3c04274503887129c832e54f4b as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/20a49e3c04274503887129c832e54f4b 2023-11-01 09:56:32,961 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20a49e3c04274503887129c832e54f4b 2023-11-01 09:56:32,962 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8d6cb8cf442ba89dc74d0fed3e135b65/family1 of 8d6cb8cf442ba89dc74d0fed3e135b65 into 20a49e3c04274503887129c832e54f4b(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:32,962 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:32,962 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:32,963 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): 8d6cb8cf442ba89dc74d0fed3e135b65/family2 is initiating major compaction (all files) 2023-11-01 09:56:32,963 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:32,963 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:32,963 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of 8d6cb8cf442ba89dc74d0fed3e135b65/family2 in testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:32,963 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/fd7b7527d42c4ed6b1b85b2c7f595837, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/cadf9c0ae8d548038efa1f6dedb7ecf7, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/00ecb6e8c8b6463bab478455fca4e15c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/131c8ea7250a4c39b6868d34e1f8ff36, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/3fc7e65b68c2417abbddeca4cf623ef8] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp, totalSize=25.4 K 2023-11-01 09:56:32,964 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting fd7b7527d42c4ed6b1b85b2c7f595837, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832584962 2023-11-01 09:56:32,964 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting cadf9c0ae8d548038efa1f6dedb7ecf7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832586452 2023-11-01 09:56:32,964 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 00ecb6e8c8b6463bab478455fca4e15c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832587918 2023-11-01 09:56:32,965 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 131c8ea7250a4c39b6868d34e1f8ff36, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832589776 2023-11-01 09:56:32,965 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 3fc7e65b68c2417abbddeca4cf623ef8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:32,973 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): 8d6cb8cf442ba89dc74d0fed3e135b65#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:32,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/459db717ea5b4f948e923d05383c76eb, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/3d11f70e6be942cfb4241324f82e9111, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/adac92b32e3740bfaed430f9907659dd, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/dbf9ee4393a54448ad5b8acd653e330d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/de96d77ddbc44df081ee902c1d1afa31] to archive 2023-11-01 09:56:32,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:32,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/459db717ea5b4f948e923d05383c76eb to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/459db717ea5b4f948e923d05383c76eb 2023-11-01 09:56:32,980 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311018265341c24344c23a9fe33fc4fae5037_del 2023-11-01 09:56:32,980 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311018265341c24344c23a9fe33fc4fae5037_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311018265341c24344c23a9fe33fc4fae5037_del 2023-11-01 09:56:32,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/3d11f70e6be942cfb4241324f82e9111 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/3d11f70e6be942cfb4241324f82e9111 2023-11-01 09:56:32,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/adac92b32e3740bfaed430f9907659dd to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/adac92b32e3740bfaed430f9907659dd 2023-11-01 09:56:32,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/dbf9ee4393a54448ad5b8acd653e330d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/dbf9ee4393a54448ad5b8acd653e330d 2023-11-01 09:56:32,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/de96d77ddbc44df081ee902c1d1afa31 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/de96d77ddbc44df081ee902c1d1afa31 2023-11-01 09:56:33,002 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dd0582081964dfca9be11d7461b26e7 2023-11-01 09:56:33,003 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/.tmp/family2/0dd0582081964dfca9be11d7461b26e7 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/0dd0582081964dfca9be11d7461b26e7 2023-11-01 09:56:33,006 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dd0582081964dfca9be11d7461b26e7 2023-11-01 09:56:33,007 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8d6cb8cf442ba89dc74d0fed3e135b65/family2 of 8d6cb8cf442ba89dc74d0fed3e135b65 into 0dd0582081964dfca9be11d7461b26e7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:33,007 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:33,007 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:33,007 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): f608f63b441ef25b7af7d5929c11a6ec/family1 is initiating major compaction (all files) 2023-11-01 09:56:33,008 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:33,008 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:33,010 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of f608f63b441ef25b7af7d5929c11a6ec/family1 in testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:33,010 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/e3c2689d19d44f43a10a7d3513f6cfe1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/f3e506f55fb044689df8cc748ea0d18d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/70d19f87dc2b473f9ade9420be55390b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/509bb258d4dc44cc8fe955eb891504b1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/64f99fb8d78a48bfaa55285121fa39d1] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp, totalSize=27.1 K 2023-11-01 09:56:33,010 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e3c2689d19d44f43a10a7d3513f6cfe1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832584962 2023-11-01 09:56:33,010 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting f3e506f55fb044689df8cc748ea0d18d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832586452 2023-11-01 09:56:33,011 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 70d19f87dc2b473f9ade9420be55390b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832587918 2023-11-01 09:56:33,011 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 509bb258d4dc44cc8fe955eb891504b1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832589776 2023-11-01 09:56:33,011 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 64f99fb8d78a48bfaa55285121fa39d1, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:33,019 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): f608f63b441ef25b7af7d5929c11a6ec#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:33,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/fd7b7527d42c4ed6b1b85b2c7f595837, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/cadf9c0ae8d548038efa1f6dedb7ecf7, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/00ecb6e8c8b6463bab478455fca4e15c, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/131c8ea7250a4c39b6868d34e1f8ff36, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/3fc7e65b68c2417abbddeca4cf623ef8] to archive 2023-11-01 09:56:33,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:33,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/fd7b7527d42c4ed6b1b85b2c7f595837 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/fd7b7527d42c4ed6b1b85b2c7f595837 2023-11-01 09:56:33,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/cadf9c0ae8d548038efa1f6dedb7ecf7 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/cadf9c0ae8d548038efa1f6dedb7ecf7 2023-11-01 09:56:33,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/00ecb6e8c8b6463bab478455fca4e15c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/00ecb6e8c8b6463bab478455fca4e15c 2023-11-01 09:56:33,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/131c8ea7250a4c39b6868d34e1f8ff36 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/131c8ea7250a4c39b6868d34e1f8ff36 2023-11-01 09:56:33,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/3fc7e65b68c2417abbddeca4cf623ef8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family2/3fc7e65b68c2417abbddeca4cf623ef8 2023-11-01 09:56:33,464 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del 2023-11-01 09:56:33,464 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del 2023-11-01 09:56:34,317 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f5c1f09612a40908dd627a33f42b950 2023-11-01 09:56:34,318 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family1/9f5c1f09612a40908dd627a33f42b950 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/9f5c1f09612a40908dd627a33f42b950 2023-11-01 09:56:34,339 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f5c1f09612a40908dd627a33f42b950 2023-11-01 09:56:34,339 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f608f63b441ef25b7af7d5929c11a6ec/family1 of f608f63b441ef25b7af7d5929c11a6ec into 9f5c1f09612a40908dd627a33f42b950(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:56:34,340 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:34,340 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:34,340 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): f608f63b441ef25b7af7d5929c11a6ec/family2 is initiating major compaction (all files) 2023-11-01 09:56:34,340 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:34,340 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:34,340 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of f608f63b441ef25b7af7d5929c11a6ec/family2 in testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:34,340 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/4fed014a0daf4e4ea14609c80674544b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/6c13884d78dc47ada34eace0594c94df, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/fd243d42f0e04d00b661bf0e8cf93bac, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/e57e1d98564c4d26a2e1e2c150d27b19, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/06a08fc18f7749c78b6226f067e54f0d] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp, totalSize=25.4 K 2023-11-01 09:56:34,341 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 4fed014a0daf4e4ea14609c80674544b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832584962 2023-11-01 09:56:34,341 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 6c13884d78dc47ada34eace0594c94df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832586452 2023-11-01 09:56:34,341 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting fd243d42f0e04d00b661bf0e8cf93bac, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832587918 2023-11-01 09:56:34,341 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e57e1d98564c4d26a2e1e2c150d27b19, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832589776 2023-11-01 09:56:34,342 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 06a08fc18f7749c78b6226f067e54f0d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:34,349 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): f608f63b441ef25b7af7d5929c11a6ec#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:34,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/e3c2689d19d44f43a10a7d3513f6cfe1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/f3e506f55fb044689df8cc748ea0d18d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/70d19f87dc2b473f9ade9420be55390b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/509bb258d4dc44cc8fe955eb891504b1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/64f99fb8d78a48bfaa55285121fa39d1] to archive 2023-11-01 09:56:34,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:34,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/e3c2689d19d44f43a10a7d3513f6cfe1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/e3c2689d19d44f43a10a7d3513f6cfe1 2023-11-01 09:56:34,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/f3e506f55fb044689df8cc748ea0d18d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/f3e506f55fb044689df8cc748ea0d18d 2023-11-01 09:56:34,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/70d19f87dc2b473f9ade9420be55390b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/70d19f87dc2b473f9ade9420be55390b 2023-11-01 09:56:34,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/509bb258d4dc44cc8fe955eb891504b1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/509bb258d4dc44cc8fe955eb891504b1 2023-11-01 09:56:34,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/64f99fb8d78a48bfaa55285121fa39d1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/64f99fb8d78a48bfaa55285121fa39d1 2023-11-01 09:56:34,756 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311010d2ee0b64a6c4a83bfac177a98dcd3f9_del 2023-11-01 09:56:34,756 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311010d2ee0b64a6c4a83bfac177a98dcd3f9_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311010d2ee0b64a6c4a83bfac177a98dcd3f9_del 2023-11-01 09:56:35,168 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7e7c0df492a428caa9a4333a62ace5f 2023-11-01 09:56:35,168 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/.tmp/family2/b7e7c0df492a428caa9a4333a62ace5f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/b7e7c0df492a428caa9a4333a62ace5f 2023-11-01 09:56:35,172 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7e7c0df492a428caa9a4333a62ace5f 2023-11-01 09:56:35,173 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f608f63b441ef25b7af7d5929c11a6ec/family2 of f608f63b441ef25b7af7d5929c11a6ec into b7e7c0df492a428caa9a4333a62ace5f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:35,173 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:35,173 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:35,173 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): ffa01e260f75ac2a0ec0e96611ab19b4/family1 is initiating major compaction (all files) 2023-11-01 09:56:35,173 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:35,173 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:35,174 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of ffa01e260f75ac2a0ec0e96611ab19b4/family1 in testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:35,174 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/7cb3b4cd84454abc8f2e0a87e22958c5, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2f89b8deb35447019d4de49e16e1c3ab, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/d511ef1d403642abbda09ff4af014d50, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/1a882b9cf1c5481a84a7e96731eed52d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2e28c3778c634a4380773f7210f768b0] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp, totalSize=27.1 K 2023-11-01 09:56:35,174 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 7cb3b4cd84454abc8f2e0a87e22958c5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832584963 2023-11-01 09:56:35,174 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 2f89b8deb35447019d4de49e16e1c3ab, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832586452 2023-11-01 09:56:35,175 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting d511ef1d403642abbda09ff4af014d50, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832587918 2023-11-01 09:56:35,175 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 1a882b9cf1c5481a84a7e96731eed52d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832589776 2023-11-01 09:56:35,175 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 2e28c3778c634a4380773f7210f768b0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:35,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/4fed014a0daf4e4ea14609c80674544b, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/6c13884d78dc47ada34eace0594c94df, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/fd243d42f0e04d00b661bf0e8cf93bac, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/e57e1d98564c4d26a2e1e2c150d27b19, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/06a08fc18f7749c78b6226f067e54f0d] to archive 2023-11-01 09:56:35,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:35,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/4fed014a0daf4e4ea14609c80674544b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/4fed014a0daf4e4ea14609c80674544b 2023-11-01 09:56:35,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/6c13884d78dc47ada34eace0594c94df to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/6c13884d78dc47ada34eace0594c94df 2023-11-01 09:56:35,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/fd243d42f0e04d00b661bf0e8cf93bac to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/fd243d42f0e04d00b661bf0e8cf93bac 2023-11-01 09:56:35,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/e57e1d98564c4d26a2e1e2c150d27b19 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/e57e1d98564c4d26a2e1e2c150d27b19 2023-11-01 09:56:35,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/06a08fc18f7749c78b6226f067e54f0d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family2/06a08fc18f7749c78b6226f067e54f0d 2023-11-01 09:56:35,184 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): ffa01e260f75ac2a0ec0e96611ab19b4#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:35,220 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del 2023-11-01 09:56:35,220 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del 2023-11-01 09:56:36,072 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9326442be8ce46e296baed78aa9b0805 2023-11-01 09:56:36,072 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family1/9326442be8ce46e296baed78aa9b0805 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/9326442be8ce46e296baed78aa9b0805 2023-11-01 09:56:36,094 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9326442be8ce46e296baed78aa9b0805 2023-11-01 09:56:36,095 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ffa01e260f75ac2a0ec0e96611ab19b4/family1 of ffa01e260f75ac2a0ec0e96611ab19b4 into 9326442be8ce46e296baed78aa9b0805(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-01 09:56:36,095 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:36,095 DEBUG [Listener at localhost/37085] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-01 09:56:36,096 DEBUG [Listener at localhost/37085] regionserver.HStore(1912): ffa01e260f75ac2a0ec0e96611ab19b4/family2 is initiating major compaction (all files) 2023-11-01 09:56:36,096 INFO [Listener at localhost/37085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-01 09:56:36,096 INFO [Listener at localhost/37085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-01 09:56:36,096 INFO [Listener at localhost/37085] regionserver.HRegion(2259): Starting compaction of ffa01e260f75ac2a0ec0e96611ab19b4/family2 in testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:36,096 INFO [Listener at localhost/37085] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/e2c566b1840c4d4c8a8a5ab3281bc562, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/d1356e2d7c9944a892c0f9eb0238e242, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/59690723d5eb494f83bbb5afbf5b4cae, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1e6f5b7fbb774c88acec856ff47d8aa1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/5004e3218d834aa789f9682a1a549989] into tmpdir=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp, totalSize=25.4 K 2023-11-01 09:56:36,096 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting e2c566b1840c4d4c8a8a5ab3281bc562, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698832584963 2023-11-01 09:56:36,097 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting d1356e2d7c9944a892c0f9eb0238e242, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698832586452 2023-11-01 09:56:36,097 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 59690723d5eb494f83bbb5afbf5b4cae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698832587918 2023-11-01 09:56:36,098 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 1e6f5b7fbb774c88acec856ff47d8aa1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698832589776 2023-11-01 09:56:36,098 DEBUG [Listener at localhost/37085] compactions.Compactor(207): Compacting 5004e3218d834aa789f9682a1a549989, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-01 09:56:36,105 INFO [Listener at localhost/37085] throttle.PressureAwareThroughputController(145): ffa01e260f75ac2a0ec0e96611ab19b4#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-01 09:56:36,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/7cb3b4cd84454abc8f2e0a87e22958c5, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2f89b8deb35447019d4de49e16e1c3ab, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/d511ef1d403642abbda09ff4af014d50, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/1a882b9cf1c5481a84a7e96731eed52d, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2e28c3778c634a4380773f7210f768b0] to archive 2023-11-01 09:56:36,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:36,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/7cb3b4cd84454abc8f2e0a87e22958c5 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/7cb3b4cd84454abc8f2e0a87e22958c5 2023-11-01 09:56:36,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2f89b8deb35447019d4de49e16e1c3ab to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2f89b8deb35447019d4de49e16e1c3ab 2023-11-01 09:56:36,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/d511ef1d403642abbda09ff4af014d50 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/d511ef1d403642abbda09ff4af014d50 2023-11-01 09:56:36,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/1a882b9cf1c5481a84a7e96731eed52d to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/1a882b9cf1c5481a84a7e96731eed52d 2023-11-01 09:56:36,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2e28c3778c634a4380773f7210f768b0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/2e28c3778c634a4380773f7210f768b0 2023-11-01 09:56:36,512 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231101723bcd1d5562445284d699efc6384900_del 2023-11-01 09:56:36,513 INFO [Listener at localhost/37085] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101723bcd1d5562445284d699efc6384900_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231101723bcd1d5562445284d699efc6384900_del 2023-11-01 09:56:37,325 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d11229a621a49178cd4d679835e912f 2023-11-01 09:56:37,325 DEBUG [Listener at localhost/37085] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/.tmp/family2/1d11229a621a49178cd4d679835e912f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1d11229a621a49178cd4d679835e912f 2023-11-01 09:56:37,328 INFO [Listener at localhost/37085] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d11229a621a49178cd4d679835e912f 2023-11-01 09:56:37,329 INFO [Listener at localhost/37085] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ffa01e260f75ac2a0ec0e96611ab19b4/family2 of ffa01e260f75ac2a0ec0e96611ab19b4 into 1d11229a621a49178cd4d679835e912f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-01 09:56:37,329 DEBUG [Listener at localhost/37085] regionserver.HRegion(2289): Compaction status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:37,333 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:37,335 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:37,338 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:37,339 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:37,345 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41153] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF6\xCD\xBE"\xC3N\x02\x94\xFD\x16-\x13P\x92\xC5\xA2"\x10N\x8F-|0gF\x80J\x92\xB0\xEAt\xE4\x9C\x86*\x10\xEC\xD4\xEA\xDB\x95\x8D2x\xFC\xF2Pts\xD8\xD2\x092\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-01 09:56:37,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-01 09:56:37,367 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-01 09:56:37,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:56:37,368 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698833197368 2023-11-01 09:56:37,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-01 09:56:37,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/e2c566b1840c4d4c8a8a5ab3281bc562, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/d1356e2d7c9944a892c0f9eb0238e242, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/59690723d5eb494f83bbb5afbf5b4cae, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1e6f5b7fbb774c88acec856ff47d8aa1, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/5004e3218d834aa789f9682a1a549989] to archive 2023-11-01 09:56:37,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:37,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/e2c566b1840c4d4c8a8a5ab3281bc562 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/e2c566b1840c4d4c8a8a5ab3281bc562 2023-11-01 09:56:37,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/d1356e2d7c9944a892c0f9eb0238e242 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/d1356e2d7c9944a892c0f9eb0238e242 2023-11-01 09:56:37,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/59690723d5eb494f83bbb5afbf5b4cae to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/59690723d5eb494f83bbb5afbf5b4cae 2023-11-01 09:56:37,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1e6f5b7fbb774c88acec856ff47d8aa1 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/1e6f5b7fbb774c88acec856ff47d8aa1 2023-11-01 09:56:37,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/5004e3218d834aa789f9682a1a549989 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family2/5004e3218d834aa789f9682a1a549989 2023-11-01 09:56:37,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-01 09:56:37,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del 2023-11-01 09:56:37,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del 2023-11-01 09:56:37,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del 2023-11-01 09:56:37,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:37,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] zookeeper.ReadOnlyZKClient(139): Connect 0x3ada8d47 to 127.0.0.1:49762 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-01 09:56:37,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f509a66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-01 09:56:37,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231101 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:38,311 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110105e98bf24d1141f4864957c6a93204e4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023110105e98bf24d1141f4864957c6a93204e4 2023-11-01 09:56:38,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:38,323 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-01 09:56:38,326 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-01 09:56:38,334 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-01 09:56:38,335 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-01 09:56:38,362 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231101/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-01 09:56:38,363 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231101/family1/2bf21d6571e44ee6a9b2988ebfcf2d58}] 2023-11-01 09:56:38,369 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231101/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 for inclusion in f608f63b441ef25b7af7d5929c11a6ec/family1 2023-11-01 09:56:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-01 09:56:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-01 09:56:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:38,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231101/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__mnpsec28l03kdbva14h4g50n11c4tippnn1hujda58uj9pl7q5rcputfbnbn9c3l/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 2023-11-01 09:56:38,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__mnpsec28l03kdbva14h4g50n11c4tippnn1hujda58uj9pl7q5rcputfbnbn9c3l/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/86cc9dd887db4052aba2b04b000ae319_SeqId_28_ 2023-11-01 09:56:38,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__mnpsec28l03kdbva14h4g50n11c4tippnn1hujda58uj9pl7q5rcputfbnbn9c3l/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 into f608f63b441ef25b7af7d5929c11a6ec/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/86cc9dd887db4052aba2b04b000ae319_SeqId_28_ - updating store file list. 2023-11-01 09:56:38,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/86cc9dd887db4052aba2b04b000ae319_SeqId_28_ into f608f63b441ef25b7af7d5929c11a6ec/family1 2023-11-01 09:56:38,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__mnpsec28l03kdbva14h4g50n11c4tippnn1hujda58uj9pl7q5rcputfbnbn9c3l/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 into f608f63b441ef25b7af7d5929c11a6ec/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/family1/86cc9dd887db4052aba2b04b000ae319_SeqId_28_) 2023-11-01 09:56:38,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__mnpsec28l03kdbva14h4g50n11c4tippnn1hujda58uj9pl7q5rcputfbnbn9c3l/family1/2bf21d6571e44ee6a9b2988ebfcf2d58 2023-11-01 09:56:38,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231101 table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:38,419 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:38,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101782c2a5d9bb14d1e9b59dc5646c70371 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101782c2a5d9bb14d1e9b59dc5646c70371 2023-11-01 09:56:38,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101a76cbd3cc6384db0b336ecd63eb3c047 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101a76cbd3cc6384db0b336ecd63eb3c047 2023-11-01 09:56:38,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101f0d5f82b3eaf4d6d8276e63e483f3a2b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101f0d5f82b3eaf4d6d8276e63e483f3a2b 2023-11-01 09:56:38,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101ffd8ffe8a78342aa91a61dfa013d151b to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231101ffd8ffe8a78342aa91a61dfa013d151b 2023-11-01 09:56:38,422 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-01 09:56:38,422 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231101' 2023-11-01 09:56:38,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231101 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:38,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231101 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:38,577 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231101bd57cb81711a491b8e443fb99c563d12 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101bd57cb81711a491b8e443fb99c563d12 2023-11-01 09:56:38,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:38,623 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231101/family1/5196d43332ed4fcdab2ca8dbdc46776f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-01 09:56:38,624 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231101/family1/5196d43332ed4fcdab2ca8dbdc46776f}] 2023-11-01 09:56:38,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231101/family1/5196d43332ed4fcdab2ca8dbdc46776f for inclusion in ffa01e260f75ac2a0ec0e96611ab19b4/family1 2023-11-01 09:56:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-01 09:56:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-01 09:56:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:38,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231101/family1/5196d43332ed4fcdab2ca8dbdc46776f to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__6g382a00dp28retmd8v8q8hkm7ach73qmplheddpead4e06ndiid40e43q7fncs3/family1/5196d43332ed4fcdab2ca8dbdc46776f 2023-11-01 09:56:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__6g382a00dp28retmd8v8q8hkm7ach73qmplheddpead4e06ndiid40e43q7fncs3/family1/5196d43332ed4fcdab2ca8dbdc46776f as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/ecb6298dbe0845d19a4847734ac1de81_SeqId_28_ 2023-11-01 09:56:38,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__6g382a00dp28retmd8v8q8hkm7ach73qmplheddpead4e06ndiid40e43q7fncs3/family1/5196d43332ed4fcdab2ca8dbdc46776f into ffa01e260f75ac2a0ec0e96611ab19b4/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/ecb6298dbe0845d19a4847734ac1de81_SeqId_28_ - updating store file list. 2023-11-01 09:56:38,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/ecb6298dbe0845d19a4847734ac1de81_SeqId_28_ into ffa01e260f75ac2a0ec0e96611ab19b4/family1 2023-11-01 09:56:38,670 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__6g382a00dp28retmd8v8q8hkm7ach73qmplheddpead4e06ndiid40e43q7fncs3/family1/5196d43332ed4fcdab2ca8dbdc46776f into ffa01e260f75ac2a0ec0e96611ab19b4/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/family1/ecb6298dbe0845d19a4847734ac1de81_SeqId_28_) 2023-11-01 09:56:38,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__6g382a00dp28retmd8v8q8hkm7ach73qmplheddpead4e06ndiid40e43q7fncs3/family1/5196d43332ed4fcdab2ca8dbdc46776f 2023-11-01 09:56:38,671 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231101 table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:38,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:38,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110144729868ae714aa98d14bd7c1c3f6b25 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110144729868ae714aa98d14bd7c1c3f6b25 2023-11-01 09:56:38,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101a01ec03857be40d5a4f92874cdb0b62a to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101a01ec03857be40d5a4f92874cdb0b62a 2023-11-01 09:56:38,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101d2e22a2e15cd4dc9846a0043d3fbeded to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101d2e22a2e15cd4dc9846a0043d3fbeded 2023-11-01 09:56:38,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101e37d35af6e214ce589e158f029ca28e3 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231101e37d35af6e214ce589e158f029ca28e3 2023-11-01 09:56:38,677 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-01 09:56:38,677 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231101' 2023-11-01 09:56:38,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231101 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:38,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231101 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:39,217 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110198fa495301be4407ac1c9f27382076d8 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110198fa495301be4407ac1c9f27382076d8 2023-11-01 09:56:39,218 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:39,260 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231101/family1/96be8a205d5c4ed1b9706ee2929fd4e4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-01 09:56:39,261 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65., hostname=jenkins-hbase4.apache.org,40233,1698832432817, seqNum=2 for row with hfile group [{family1,hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231101/family1/96be8a205d5c4ed1b9706ee2929fd4e4}] 2023-11-01 09:56:39,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(763): Validating hfile at hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231101/family1/96be8a205d5c4ed1b9706ee2929fd4e4 for inclusion in 8d6cb8cf442ba89dc74d0fed3e135b65/family1 2023-11-01 09:56:39,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-01 09:56:39,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(777): Region bounds: first= last=1 2023-11-01 09:56:39,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegion(2446): Flush status journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:39,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231101/family1/96be8a205d5c4ed1b9706ee2929fd4e4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__spf673ucnpuh5n0is0cfkcl4r91n6rtc3rg6vqdnhtbasduld1bmm9sce15tgsq9/family1/96be8a205d5c4ed1b9706ee2929fd4e4 2023-11-01 09:56:39,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__spf673ucnpuh5n0is0cfkcl4r91n6rtc3rg6vqdnhtbasduld1bmm9sce15tgsq9/family1/96be8a205d5c4ed1b9706ee2929fd4e4 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/73238c07a0ad4d13ba66c3bbd0b93119_SeqId_28_ 2023-11-01 09:56:39,286 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(849): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__spf673ucnpuh5n0is0cfkcl4r91n6rtc3rg6vqdnhtbasduld1bmm9sce15tgsq9/family1/96be8a205d5c4ed1b9706ee2929fd4e4 into 8d6cb8cf442ba89dc74d0fed3e135b65/family1 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/73238c07a0ad4d13ba66c3bbd0b93119_SeqId_28_ - updating store file list. 2023-11-01 09:56:39,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(882): Loaded HFile hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/73238c07a0ad4d13ba66c3bbd0b93119_SeqId_28_ into 8d6cb8cf442ba89dc74d0fed3e135b65/family1 2023-11-01 09:56:39,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.HStore(855): Successfully loaded hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__spf673ucnpuh5n0is0cfkcl4r91n6rtc3rg6vqdnhtbasduld1bmm9sce15tgsq9/family1/96be8a205d5c4ed1b9706ee2929fd4e4 into 8d6cb8cf442ba89dc74d0fed3e135b65/family1 (new location: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/family1/73238c07a0ad4d13ba66c3bbd0b93119_SeqId_28_) 2023-11-01 09:56:39,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40233] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/staging/jenkins__testMajorCompactionFromAdmin__spf673ucnpuh5n0is0cfkcl4r91n6rtc3rg6vqdnhtbasduld1bmm9sce15tgsq9/family1/96be8a205d5c4ed1b9706ee2929fd4e4 2023-11-01 09:56:39,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231101 table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:39,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:39,323 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101313aae45d2b04977a788eff42c17efa4 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101313aae45d2b04977a788eff42c17efa4 2023-11-01 09:56:39,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110166e702dca87549f689c411ac2187ac8c to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110166e702dca87549f689c411ac2187ac8c 2023-11-01 09:56:39,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311018609577d10584d53a58752a606f5d287 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311018609577d10584d53a58752a606f5d287 2023-11-01 09:56:39,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101aec1786e855d425eb4147ed9b0e592b0 to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101aec1786e855d425eb4147ed9b0e592b0 2023-11-01 09:56:39,326 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-01 09:56:39,326 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231101' 2023-11-01 09:56:39,326 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231101 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:39,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-01 09:56:39,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-01 09:56:39,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del] 2023-11-01 09:56:39,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:39,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231101559c7a2c216e48908360d4853f229bf7_del 2023-11-01 09:56:39,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-01 09:56:39,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del] 2023-11-01 09:56:39,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:39,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311012e475cb8ffe64ab2a1e853897403c5b5_del 2023-11-01 09:56:39,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-01 09:56:39,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] compactions.PartitionedMobCompactor(367): [hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del] 2023-11-01 09:56:39,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] backup.HFileArchiver(360): Archiving compacted files. 2023-11-01 09:56:39,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del to hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311017a806285327d4964b3b80a0f914c08d3_del 2023-11-01 09:56:39,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-01 09:56:39,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698832436274] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-01 09:56:39,332 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-01 09:56:39,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 1.9660 sec 2023-11-01 09:56:39,345 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:39,347 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:39,350 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-01 09:56:39,351 DEBUG [Listener at localhost/37085] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-01 09:56:39,354 INFO [Listener at localhost/37085] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-01 09:56:39,392 INFO [Listener at localhost/37085] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 255), OpenFileDescriptor=639 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 190) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=10933 (was 10932) - AvailableMemoryMB LEAK? - 2023-11-01 09:56:39,392 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x339b0ded to 127.0.0.1:49762 2023-11-01 09:56:39,392 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:39,393 INFO [Listener at localhost/37085] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-01 09:56:39,393 INFO [Listener at localhost/37085] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-01 09:56:39,393 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2da24397 to 127.0.0.1:49762 2023-11-01 09:56:39,393 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:39,393 DEBUG [Listener at localhost/37085] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-01 09:56:39,393 DEBUG [Listener at localhost/37085] util.JVMClusterUtil(257): Found active master hash=70161496, stopped=false 2023-11-01 09:56:39,393 INFO [Listener at localhost/37085] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:56:39,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-01 09:56:39,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-01 09:56:39,395 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:56:39,395 INFO [Listener at localhost/37085] procedure2.ProcedureExecutor(628): Stopping 2023-11-01 09:56:39,395 DEBUG [Listener at localhost/37085] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6524041a to 127.0.0.1:49762 2023-11-01 09:56:39,395 DEBUG [Listener at localhost/37085] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:39,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-01 09:56:39,395 INFO [Listener at localhost/37085] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40233,1698832432817' ***** 2023-11-01 09:56:39,396 INFO [Listener at localhost/37085] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-01 09:56:39,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-01 09:56:39,396 INFO [RS:0;jenkins-hbase4:40233] regionserver.HeapMemoryManager(220): Stopping 2023-11-01 09:56:39,396 INFO [RS:0;jenkins-hbase4:40233] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-01 09:56:39,396 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-01 09:56:39,396 INFO [RS:0;jenkins-hbase4:40233] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-01 09:56:39,396 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for bf7cf4be28cce55b870b7451ab8d5fef 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 4a0560c30c274df40af64b053783ad7e 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 46e683a163a0dbf6891bd67423ae4815 2023-11-01 09:56:39,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf7cf4be28cce55b870b7451ab8d5fef, disabling compactions & flushes 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 8d6cb8cf442ba89dc74d0fed3e135b65 2023-11-01 09:56:39,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for e2584f1b9fc06508be08e77278378d04 2023-11-01 09:56:39,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 2545414ff76df89ec2e286e567bebe0f 2023-11-01 09:56:39,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. after waiting 0 ms 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for f608f63b441ef25b7af7d5929c11a6ec 2023-11-01 09:56:39,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for b12ce301cd7fb26d2cfa7146f93bc0fb 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 710b0d496f991a4a7c3efb796275d459 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 3fee1307da01b6d821587a0ba912a96d 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for a64472f1d773fc81816fad418927b98c 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 6f8f2e3d3c925badce7580bd7572b250 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 70058c73ccbece118d377978f7fa6427 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for ce95d44a8b3e79de7f5aab9d535373ee 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 2e105341a2540afe949315054ef0502f 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for a1270fae216de4a507f8780689d9bb05 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 1388645b6ecdeccc3d9fbf68cdb7b63c 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for cea8e1796b56252af8d44bbee2eec2a1 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 69910e0ca18b4fdfb4a00f4bd1dc27f0 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:39,397 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:39,397 DEBUG [RS:0;jenkins-hbase4:40233] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e7f85d0 to 127.0.0.1:49762 2023-11-01 09:56:39,398 DEBUG [RS:0;jenkins-hbase4:40233] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:39,398 INFO [RS:0;jenkins-hbase4:40233] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-01 09:56:39,398 INFO [RS:0;jenkins-hbase4:40233] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-01 09:56:39,398 INFO [RS:0;jenkins-hbase4:40233] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-01 09:56:39,398 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-01 09:56:39,398 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-01 09:56:39,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-01 09:56:39,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-01 09:56:39,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-01 09:56:39,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-01 09:56:39,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-01 09:56:39,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-01 09:56:39,399 DEBUG [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1504): Waiting on 1388645b6ecdeccc3d9fbf68cdb7b63c, 1588230740, 2545414ff76df89ec2e286e567bebe0f, 2e105341a2540afe949315054ef0502f, 3fee1307da01b6d821587a0ba912a96d, 46e683a163a0dbf6891bd67423ae4815, 4a0560c30c274df40af64b053783ad7e, 69910e0ca18b4fdfb4a00f4bd1dc27f0, 6f8f2e3d3c925badce7580bd7572b250, 70058c73ccbece118d377978f7fa6427, 710b0d496f991a4a7c3efb796275d459, 8d6cb8cf442ba89dc74d0fed3e135b65, a1270fae216de4a507f8780689d9bb05, a64472f1d773fc81816fad418927b98c, b12ce301cd7fb26d2cfa7146f93bc0fb, bf7cf4be28cce55b870b7451ab8d5fef, ce95d44a8b3e79de7f5aab9d535373ee, cea8e1796b56252af8d44bbee2eec2a1, e2584f1b9fc06508be08e77278378d04, f608f63b441ef25b7af7d5929c11a6ec, ffa01e260f75ac2a0ec0e96611ab19b4 2023-11-01 09:56:39,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithMonthlyPolicy/bf7cf4be28cce55b870b7451ab8d5fef/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-01 09:56:39,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:39,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf7cf4be28cce55b870b7451ab8d5fef: 2023-11-01 09:56:39,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698832568969.bf7cf4be28cce55b870b7451ab8d5fef. 2023-11-01 09:56:39,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a0560c30c274df40af64b053783ad7e, disabling compactions & flushes 2023-11-01 09:56:39,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:56:39,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:56:39,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. after waiting 0 ms 2023-11-01 09:56:39,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:56:39,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4a0560c30c274df40af64b053783ad7e/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-01 09:56:39,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:56:39,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a0560c30c274df40af64b053783ad7e: 2023-11-01 09:56:39,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698832502720.4a0560c30c274df40af64b053783ad7e. 2023-11-01 09:56:39,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 46e683a163a0dbf6891bd67423ae4815, disabling compactions & flushes 2023-11-01 09:56:39,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:39,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:39,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. after waiting 0 ms 2023-11-01 09:56:39,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:39,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/.tmp/info/b364178889ac4b798c8b92bcd8b27fce 2023-11-01 09:56:39,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/46e683a163a0dbf6891bd67423ae4815/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-01 09:56:39,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:39,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 46e683a163a0dbf6891bd67423ae4815: 2023-11-01 09:56:39,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698832551767.46e683a163a0dbf6891bd67423ae4815. 2023-11-01 09:56:39,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d6cb8cf442ba89dc74d0fed3e135b65, disabling compactions & flushes 2023-11-01 09:56:39,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:39,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:39,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. after waiting 0 ms 2023-11-01 09:56:39,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:39,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b364178889ac4b798c8b92bcd8b27fce 2023-11-01 09:56:39,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/8d6cb8cf442ba89dc74d0fed3e135b65/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-01 09:56:39,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d6cb8cf442ba89dc74d0fed3e135b65: 2023-11-01 09:56:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698832582817.8d6cb8cf442ba89dc74d0fed3e135b65. 2023-11-01 09:56:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e2584f1b9fc06508be08e77278378d04, disabling compactions & flushes 2023-11-01 09:56:39,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:56:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:56:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. after waiting 0 ms 2023-11-01 09:56:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:56:39,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/.tmp/rep_barrier/0c550e3b154341068696e0e88aabd79d 2023-11-01 09:56:39,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/e2584f1b9fc06508be08e77278378d04/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-01 09:56:39,423 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-01 09:56:39,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:56:39,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e2584f1b9fc06508be08e77278378d04: 2023-11-01 09:56:39,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698832470393.e2584f1b9fc06508be08e77278378d04. 2023-11-01 09:56:39,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2545414ff76df89ec2e286e567bebe0f, disabling compactions & flushes 2023-11-01 09:56:39,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:56:39,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:56:39,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. after waiting 0 ms 2023-11-01 09:56:39,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:56:39,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c550e3b154341068696e0e88aabd79d 2023-11-01 09:56:39,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyPolicy/2545414ff76df89ec2e286e567bebe0f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-01 09:56:39,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:56:39,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2545414ff76df89ec2e286e567bebe0f: 2023-11-01 09:56:39,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698832474586.2545414ff76df89ec2e286e567bebe0f. 2023-11-01 09:56:39,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f608f63b441ef25b7af7d5929c11a6ec, disabling compactions & flushes 2023-11-01 09:56:39,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:39,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:39,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. after waiting 0 ms 2023-11-01 09:56:39,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:39,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/f608f63b441ef25b7af7d5929c11a6ec/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-01 09:56:39,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:39,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f608f63b441ef25b7af7d5929c11a6ec: 2023-11-01 09:56:39,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698832582817.f608f63b441ef25b7af7d5929c11a6ec. 2023-11-01 09:56:39,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b12ce301cd7fb26d2cfa7146f93bc0fb, disabling compactions & flushes 2023-11-01 09:56:39,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:56:39,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:56:39,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. after waiting 0 ms 2023-11-01 09:56:39,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:56:39,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b12ce301cd7fb26d2cfa7146f93bc0fb 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-01 09:56:39,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/.tmp/table/8b782ece2b7c4aca971f2f05642b854d 2023-11-01 09:56:39,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/.tmp/info/f5811c5ad1704c07b9626cddea8900a8 2023-11-01 09:56:39,441 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b782ece2b7c4aca971f2f05642b854d 2023-11-01 09:56:39,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/.tmp/info/b364178889ac4b798c8b92bcd8b27fce as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/info/b364178889ac4b798c8b92bcd8b27fce 2023-11-01 09:56:39,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/.tmp/info/f5811c5ad1704c07b9626cddea8900a8 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/info/f5811c5ad1704c07b9626cddea8900a8 2023-11-01 09:56:39,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b364178889ac4b798c8b92bcd8b27fce 2023-11-01 09:56:39,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/info/b364178889ac4b798c8b92bcd8b27fce, entries=226, sequenceid=130, filesize=37.9 K 2023-11-01 09:56:39,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/.tmp/rep_barrier/0c550e3b154341068696e0e88aabd79d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/rep_barrier/0c550e3b154341068696e0e88aabd79d 2023-11-01 09:56:39,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/info/f5811c5ad1704c07b9626cddea8900a8, entries=3, sequenceid=7, filesize=4.8 K 2023-11-01 09:56:39,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for b12ce301cd7fb26d2cfa7146f93bc0fb in 13ms, sequenceid=7, compaction requested=false 2023-11-01 09:56:39,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c550e3b154341068696e0e88aabd79d 2023-11-01 09:56:39,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/rep_barrier/0c550e3b154341068696e0e88aabd79d, entries=1, sequenceid=130, filesize=5.0 K 2023-11-01 09:56:39,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/namespace/b12ce301cd7fb26d2cfa7146f93bc0fb/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/.tmp/table/8b782ece2b7c4aca971f2f05642b854d as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/table/8b782ece2b7c4aca971f2f05642b854d 2023-11-01 09:56:39,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b12ce301cd7fb26d2cfa7146f93bc0fb: 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698832435557.b12ce301cd7fb26d2cfa7146f93bc0fb. 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 710b0d496f991a4a7c3efb796275d459, disabling compactions & flushes 2023-11-01 09:56:39,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. after waiting 0 ms 2023-11-01 09:56:39,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:56:39,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b782ece2b7c4aca971f2f05642b854d 2023-11-01 09:56:39,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/710b0d496f991a4a7c3efb796275d459/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-01 09:56:39,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/table/8b782ece2b7c4aca971f2f05642b854d, entries=27, sequenceid=130, filesize=6.6 K 2023-11-01 09:56:39,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:56:39,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 710b0d496f991a4a7c3efb796275d459: 2023-11-01 09:56:39,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698832436390.710b0d496f991a4a7c3efb796275d459. 2023-11-01 09:56:39,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3fee1307da01b6d821587a0ba912a96d, disabling compactions & flushes 2023-11-01 09:56:39,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=130, compaction requested=false 2023-11-01 09:56:39,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:56:39,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:56:39,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. after waiting 0 ms 2023-11-01 09:56:39,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:56:39,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/3fee1307da01b6d821587a0ba912a96d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-01 09:56:39,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-01 09:56:39,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3fee1307da01b6d821587a0ba912a96d: 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698832470393.3fee1307da01b6d821587a0ba912a96d. 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a64472f1d773fc81816fad418927b98c, disabling compactions & flushes 2023-11-01 09:56:39,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. after waiting 0 ms 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:56:39,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-01 09:56:39,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a64472f1d773fc81816fad418927b98c/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-01 09:56:39,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a64472f1d773fc81816fad418927b98c: 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698832486113.a64472f1d773fc81816fad418927b98c. 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f8f2e3d3c925badce7580bd7572b250, disabling compactions & flushes 2023-11-01 09:56:39,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. after waiting 0 ms 2023-11-01 09:56:39,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:56:39,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/6f8f2e3d3c925badce7580bd7572b250/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-01 09:56:39,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:56:39,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f8f2e3d3c925badce7580bd7572b250: 2023-11-01 09:56:39,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698832525867.6f8f2e3d3c925badce7580bd7572b250. 2023-11-01 09:56:39,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 70058c73ccbece118d377978f7fa6427, disabling compactions & flushes 2023-11-01 09:56:39,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:56:39,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:56:39,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. after waiting 0 ms 2023-11-01 09:56:39,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionWithMonthlyPolicy/70058c73ccbece118d377978f7fa6427/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-01 09:56:39,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 70058c73ccbece118d377978f7fa6427: 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698832446505.70058c73ccbece118d377978f7fa6427. 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce95d44a8b3e79de7f5aab9d535373ee, disabling compactions & flushes 2023-11-01 09:56:39,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. after waiting 0 ms 2023-11-01 09:56:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:56:39,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/ce95d44a8b3e79de7f5aab9d535373ee/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-01 09:56:39,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:56:39,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce95d44a8b3e79de7f5aab9d535373ee: 2023-11-01 09:56:39,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698832525867.ce95d44a8b3e79de7f5aab9d535373ee. 2023-11-01 09:56:39,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e105341a2540afe949315054ef0502f, disabling compactions & flushes 2023-11-01 09:56:39,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:39,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:39,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. after waiting 0 ms 2023-11-01 09:56:39,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:39,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/2e105341a2540afe949315054ef0502f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-01 09:56:39,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:39,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e105341a2540afe949315054ef0502f: 2023-11-01 09:56:39,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698832551767.2e105341a2540afe949315054ef0502f. 2023-11-01 09:56:39,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1270fae216de4a507f8780689d9bb05, disabling compactions & flushes 2023-11-01 09:56:39,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:56:39,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:56:39,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. after waiting 0 ms 2023-11-01 09:56:39,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:56:39,483 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testCompactionWithHFileLink/a1270fae216de4a507f8780689d9bb05/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-01 09:56:39,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1270fae216de4a507f8780689d9bb05: 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698832525867.a1270fae216de4a507f8780689d9bb05. 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1388645b6ecdeccc3d9fbf68cdb7b63c, disabling compactions & flushes 2023-11-01 09:56:39,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. after waiting 0 ms 2023-11-01 09:56:39,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:56:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMinorCompactionWithWeeklyPolicy/1388645b6ecdeccc3d9fbf68cdb7b63c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-01 09:56:39,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:56:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1388645b6ecdeccc3d9fbf68cdb7b63c: 2023-11-01 09:56:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698832457804.1388645b6ecdeccc3d9fbf68cdb7b63c. 2023-11-01 09:56:39,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cea8e1796b56252af8d44bbee2eec2a1, disabling compactions & flushes 2023-11-01 09:56:39,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:39,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:39,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. after waiting 0 ms 2023-11-01 09:56:39,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/ns/testMinorCompaction/cea8e1796b56252af8d44bbee2eec2a1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-01 09:56:39,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cea8e1796b56252af8d44bbee2eec2a1: 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698832551767.cea8e1796b56252af8d44bbee2eec2a1. 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69910e0ca18b4fdfb4a00f4bd1dc27f0, disabling compactions & flushes 2023-11-01 09:56:39,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. after waiting 0 ms 2023-11-01 09:56:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:56:39,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testScannerOnBulkLoadRefHFiles/69910e0ca18b4fdfb4a00f4bd1dc27f0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-01 09:56:39,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:56:39,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69910e0ca18b4fdfb4a00f4bd1dc27f0: 2023-11-01 09:56:39,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698832470393.69910e0ca18b4fdfb4a00f4bd1dc27f0. 2023-11-01 09:56:39,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ffa01e260f75ac2a0ec0e96611ab19b4, disabling compactions & flushes 2023-11-01 09:56:39,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:39,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:39,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. after waiting 0 ms 2023-11-01 09:56:39,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:39,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/data/default/testMajorCompactionFromAdmin/ffa01e260f75ac2a0ec0e96611ab19b4/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-01 09:56:39,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:39,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ffa01e260f75ac2a0ec0e96611ab19b4: 2023-11-01 09:56:39,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698832582817.ffa01e260f75ac2a0ec0e96611ab19b4. 2023-11-01 09:56:39,599 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40233,1698832432817; all regions closed. 2023-11-01 09:56:39,607 DEBUG [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/oldWALs 2023-11-01 09:56:39,607 INFO [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40233%2C1698832432817.meta:.meta(num 1698832435277) 2023-11-01 09:56:39,611 DEBUG [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/oldWALs 2023-11-01 09:56:39,611 INFO [RS:0;jenkins-hbase4:40233] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40233%2C1698832432817:(num 1698832434299) 2023-11-01 09:56:39,611 DEBUG [RS:0;jenkins-hbase4:40233] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:39,611 INFO [RS:0;jenkins-hbase4:40233] regionserver.LeaseManager(133): Closed leases 2023-11-01 09:56:39,612 INFO [RS:0;jenkins-hbase4:40233] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-01 09:56:39,612 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-01 09:56:39,613 INFO [RS:0;jenkins-hbase4:40233] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40233 2023-11-01 09:56:39,622 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-01 09:56:39,622 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40233,1698832432817 2023-11-01 09:56:39,622 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-01 09:56:39,623 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40233,1698832432817] 2023-11-01 09:56:39,623 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40233,1698832432817; numProcessing=1 2023-11-01 09:56:39,624 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40233,1698832432817 already deleted, retry=false 2023-11-01 09:56:39,624 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,40233,1698832432817 expired; onlineServers=0 2023-11-01 09:56:39,624 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41153,1698832431566' ***** 2023-11-01 09:56:39,624 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-01 09:56:39,625 DEBUG [M:0;jenkins-hbase4:41153] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45139e63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-01 09:56:39,625 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41153,1698832431566 2023-11-01 09:56:39,625 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41153,1698832431566; all regions closed. 2023-11-01 09:56:39,625 DEBUG [M:0;jenkins-hbase4:41153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-01 09:56:39,625 DEBUG [M:0;jenkins-hbase4:41153] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-01 09:56:39,625 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-01 09:56:39,625 DEBUG [M:0;jenkins-hbase4:41153] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-01 09:56:39,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698832433990] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698832433990,5,FailOnTimeoutGroup] 2023-11-01 09:56:39,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698832433990] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698832433990,5,FailOnTimeoutGroup] 2023-11-01 09:56:39,626 INFO [M:0;jenkins-hbase4:41153] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-01 09:56:39,626 INFO [M:0;jenkins-hbase4:41153] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-01 09:56:39,626 INFO [M:0;jenkins-hbase4:41153] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-01 09:56:39,626 DEBUG [M:0;jenkins-hbase4:41153] master.HMaster(1512): Stopping service threads 2023-11-01 09:56:39,626 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-01 09:56:39,626 INFO [M:0;jenkins-hbase4:41153] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-01 09:56:39,627 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-01 09:56:39,627 ERROR [M:0;jenkins-hbase4:41153] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-01 09:56:39,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-01 09:56:39,627 INFO [M:0;jenkins-hbase4:41153] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-01 09:56:39,628 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-01 09:56:39,628 DEBUG [M:0;jenkins-hbase4:41153] zookeeper.ZKUtil(398): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-01 09:56:39,628 WARN [M:0;jenkins-hbase4:41153] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-01 09:56:39,628 INFO [M:0;jenkins-hbase4:41153] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-01 09:56:39,628 INFO [M:0;jenkins-hbase4:41153] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-01 09:56:39,628 DEBUG [M:0;jenkins-hbase4:41153] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-01 09:56:39,628 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:56:39,628 DEBUG [M:0;jenkins-hbase4:41153] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:56:39,628 DEBUG [M:0;jenkins-hbase4:41153] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-01 09:56:39,628 DEBUG [M:0;jenkins-hbase4:41153] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:56:39,628 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.50 KB heapSize=598.26 KB 2023-11-01 09:56:39,724 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-01 09:56:39,724 INFO [RS:0;jenkins-hbase4:40233] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40233,1698832432817; zookeeper connection closed. 2023-11-01 09:56:39,724 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): regionserver:40233-0x101a10cedf10001, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-01 09:56:39,724 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c5b263] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c5b263 2023-11-01 09:56:39,724 INFO [Listener at localhost/37085] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-01 09:56:40,036 INFO [M:0;jenkins-hbase4:41153] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.50 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/04fe47dc3bf44c14917fa7666da149a7 2023-11-01 09:56:40,041 INFO [M:0;jenkins-hbase4:41153] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04fe47dc3bf44c14917fa7666da149a7 2023-11-01 09:56:40,041 DEBUG [M:0;jenkins-hbase4:41153] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/04fe47dc3bf44c14917fa7666da149a7 as hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/04fe47dc3bf44c14917fa7666da149a7 2023-11-01 09:56:40,045 INFO [M:0;jenkins-hbase4:41153] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04fe47dc3bf44c14917fa7666da149a7 2023-11-01 09:56:40,046 INFO [M:0;jenkins-hbase4:41153] regionserver.HStore(1080): Added hdfs://localhost:43023/user/jenkins/test-data/74367720-f70e-318e-d1be-1dc9ab078659/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/04fe47dc3bf44c14917fa7666da149a7, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-01 09:56:40,046 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegion(2948): Finished flush of dataSize ~512.50 KB/524802, heapSize ~598.24 KB/612600, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 418ms, sequenceid=1006, compaction requested=false 2023-11-01 09:56:40,047 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-01 09:56:40,047 DEBUG [M:0;jenkins-hbase4:41153] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-01 09:56:40,049 INFO [M:0;jenkins-hbase4:41153] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-01 09:56:40,049 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-01 09:56:40,050 INFO [M:0;jenkins-hbase4:41153] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41153 2023-11-01 09:56:40,052 DEBUG [M:0;jenkins-hbase4:41153] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41153,1698832431566 already deleted, retry=false 2023-11-01 09:56:40,153 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-01 09:56:40,154 INFO [M:0;jenkins-hbase4:41153] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41153,1698832431566; zookeeper connection closed. 2023-11-01 09:56:40,154 DEBUG [Listener at localhost/37085-EventThread] zookeeper.ZKWatcher(600): master:41153-0x101a10cedf10000, quorum=127.0.0.1:49762, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-01 09:56:40,155 WARN [Listener at localhost/37085] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-01 09:56:40,160 INFO [Listener at localhost/37085] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-01 09:56:40,267 WARN [BP-1579401383-172.31.14.131-1698832428297 heartbeating to localhost/127.0.0.1:43023] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-01 09:56:40,267 WARN [BP-1579401383-172.31.14.131-1698832428297 heartbeating to localhost/127.0.0.1:43023] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1579401383-172.31.14.131-1698832428297 (Datanode Uuid 4ad3621f-380f-4aed-bfb9-74cd49256923) service to localhost/127.0.0.1:43023 2023-11-01 09:56:40,268 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/dfs/data/data1/current/BP-1579401383-172.31.14.131-1698832428297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-01 09:56:40,268 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1afaff6f-f678-46c0-86b0-6fe2309d498f/cluster_bc6f9148-4cf1-c4a1-7b22-42030969053e/dfs/data/data2/current/BP-1579401383-172.31.14.131-1698832428297] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-01 09:56:40,299 INFO [Listener at localhost/37085] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-01 09:56:40,430 INFO [Listener at localhost/37085] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-01 09:56:40,517 INFO [Listener at localhost/37085] hbase.HBaseTestingUtility(1293): Minicluster is down