2024-02-07 11:53:11,358 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-07 11:53:11,665 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-07 11:53:11,772 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-07 11:53:11,837 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-07 11:53:11,849 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-07 11:53:11,866 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=167, AvailableMemoryMB=3639
2024-02-07 11:53:11,868 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-07 11:53:11,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-07 11:53:12,011 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022293250:84 , srv1029454566:84 , srv1041989920:84 , srv1062005010:84 , srv1072842841:84 , srv1074808585:84 , srv1152225841:84 , srv1178099933:84 , srv1195001775:84 , srv1209285944:84 , srv1234172651:84 , srv1234988486:84 , srv1237210056:84 , srv123918442:84 , srv1266667485:84 , srv1266874144:84 , srv1286607652:84 , srv1287668514:84 , srv1292825720:84 , srv1302307276:84 , srv1330536601:84 , srv1341711730:84 , srv134384270:84 , srv1398714577:84 , srv1420125403:84 , srv1441856154:84 , srv1463214933:84 , srv1496294939:84 , srv1513532862:84 , srv152233165:84 , srv1542500382:84 , srv1561595578:84 , srv1595671959:84 , srv1642709607:84 , srv1692885859:84 , srv1694372103:84 , srv1725177281:84 , srv1740711358:84 , srv1742450762:84 , srv176800296:84 , srv1781565892:84 , srv1781955382:84 , srv179716218:84 , srv1835266775:84 , srv1846756741:84 , srv1868401705:84 , srv1881807692:84 , srv1883335406:84 , srv1893959344:84 , srv1916977548:84 , srv1942707100:84 , srv1944182289:84 , srv195696742:84 , srv1999265678:84 , srv2010252766:84 , srv2037917946:84 , srv2042283891:84 , srv2103688509:84 , srv2111811135:84 , srv2141163574:84 , srv214256325:84 , srv240535635:84 , srv247824868:84 , srv254680750:84 , srv260477232:84 , srv290887630:84 , srv301042146:84 , srv302671678:84 , srv307586931:84 , srv338261570:84 , srv345433051:84 , srv354911866:84 , srv388361600:84 , srv401993062:84 , srv411364397:84 , srv451663271:84 , srv564481136:84 , srv571825717:84 , srv594448349:84 , srv599225447:84 , srv604407099:84 , srv654588509:84 , srv668570672:84 , srv686667820:84 , srv712374344:84 , srv713276190:84 , srv719424698:84 , srv73030378:84 , srv761140624:84 , srv789828428:84 , srv794164448:84 , srv805567636:84 , srv822100083:84 , srv866707969:84 , srv911090858:84 , srv922542381:84 , srv932577419:84 , srv937683361:84 , srv949399562:84 , srv703278845:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-07 11:53:12,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:12,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv937683361=98, srv713276190=86, srv1287668514=17, srv307586931=68, srv1398714577=23, srv1195001775=8, srv1072842841=4, srv134384270=22, srv1029454566=1, srv1725177281=36, srv1237210056=12, srv1561595578=31, srv949399562=99, srv301042146=66, srv1330536601=20, srv2037917946=55, srv1595671959=32, srv1883335406=47, srv354911866=71, srv302671678=67, srv152233165=29, srv388361600=72, srv2042283891=56, srv822100083=93, srv604407099=80, srv668570672=82, srv571825717=77, srv1944182289=51, srv1740711358=37, srv1781565892=40, srv712374344=85, srv1022293250=0, srv761140624=89, srv411364397=74, srv1292825720=18, srv1266667485=14, srv1420125403=24, srv922542381=96, srv1463214933=26, srv794164448=91, srv1062005010=3, srv1999265678=53, srv73030378=88, srv1234988486=11, srv1781955382=41, srv1341711730=21, srv1916977548=49, srv401993062=73, srv1868401705=45, srv594448349=78, srv866707969=94, srv911090858=95, srv176800296=39, srv1692885859=34, srv290887630=65, srv932577419=97, srv254680750=63, srv214256325=60, srv703278845=84, srv654588509=81, srv1441856154=25, srv1041989920=2, srv1074808585=5, srv1893959344=48, srv1152225841=6, srv1846756741=44, srv123918442=13, srv1835266775=43, srv1496294939=27, srv260477232=64, srv564481136=76, srv1642709607=33, srv451663271=75, srv1302307276=19, srv338261570=69, srv345433051=70, srv195696742=52, srv789828428=90, srv1209285944=9, srv719424698=87, srv686667820=83, srv2111811135=58, srv2141163574=59, srv1286607652=16, srv1742450762=38, srv1542500382=30, srv1881807692=46, srv805567636=92, srv1234172651=10, srv1266874144=15, srv179716218=42, srv599225447=79, srv240535635=61, srv247824868=62, srv1942707100=50, srv1178099933=7, srv1694372103=35, srv2010252766=54, srv1513532862=28, srv2103688509=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:12,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:12,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:12,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:12,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:12,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 11:53:12,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 11:53:12,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 11:53:12,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 11:53:12,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 11:53:12,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 11:53:12,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 11:53:12,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 11:53:12,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 11:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 11:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 11:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 11:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 11:53:12,351 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:12,351 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 11:53:12,351 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 11:53:12,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 553 ms to try 5000 different iterations.  Found a solution that moves 4658 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18193933033906748. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038380525839564, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05809354274093672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5175555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038380525839564, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.238, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:12,757 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1152225841:82 , srv1561595578:82 , srv354911866:82 , srv594448349:82 , srv719424698:82 , srv1209285944:83 , srv1234172651:83 , srv1266874144:83 , srv134384270:83 , srv1781565892:83 , srv2103688509:83 , srv254680750:83 , srv307586931:83 , srv805567636:83 , srv1029454566:84 , srv1496294939:84 , srv1725177281:84 , srv1868401705:84 , srv1944182289:84 , srv240535635:84 , srv599225447:84 , srv761140624:84 , srv822100083:84 , srv911090858:84 , srv1022293250:85 , srv1062005010:85 , srv1178099933:85 , srv1513532862:85 , srv1542500382:85 , srv1694372103:85 , srv2037917946:85 , srv2111811135:85 , srv2141163574:85 , srv214256325:85 , srv411364397:85 , srv571825717:85 , srv949399562:85 , srv1195001775:86 , srv123918442:86 , srv1286607652:86 , srv1287668514:86 , srv1302307276:86 , srv1441856154:86 , srv1893959344:86 , srv1916977548:86 , srv338261570:86 , srv451663271:86 , srv564481136:86 , srv654588509:86 , srv712374344:86 , srv713276190:86 , srv1072842841:87 , srv1074808585:87 , srv1341711730:87 , srv1398714577:87 , srv1692885859:87 , srv1740711358:87 , srv1781955382:87 , srv179716218:87 , srv1835266775:87 , srv1883335406:87 , srv1942707100:87 , srv2042283891:87 , srv302671678:87 , srv345433051:87 , srv668570672:87 , srv789828428:87 , srv1041989920:88 , srv1463214933:88 , srv152233165:88 , srv1595671959:88 , srv1642709607:88 , srv176800296:88 , srv1999265678:88 , srv260477232:88 , srv290887630:88 , srv301042146:88 , srv388361600:88 , srv604407099:88 , srv686667820:88 , srv794164448:88 , srv932577419:88 , srv1234988486:89 , srv1237210056:89 , srv1266667485:89 , srv1292825720:89 , srv1742450762:89 , srv401993062:89 , srv922542381:89 , srv1330536601:90 , srv247824868:90 , srv73030378:90 , srv1846756741:91 , srv195696742:91 , srv2010252766:91 , srv937683361:91 , srv1420125403:92 , srv1881807692:92 , srv866707969:92 , srv703278845:449 }
2024-02-07 11:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv937683361=98, srv713276190=86, srv1287668514=17, srv307586931=68, srv1398714577=23, srv1195001775=8, srv1072842841=4, srv134384270=22, srv1029454566=1, srv1725177281=36, srv1237210056=12, srv1561595578=31, srv949399562=99, srv301042146=66, srv1330536601=20, srv2037917946=55, srv1595671959=32, srv1883335406=47, srv354911866=71, srv302671678=67, srv152233165=29, srv388361600=72, srv2042283891=56, srv822100083=93, srv604407099=80, srv668570672=82, srv571825717=77, srv1944182289=51, srv1740711358=37, srv1781565892=40, srv712374344=85, srv1022293250=0, srv761140624=89, srv411364397=74, srv1292825720=18, srv1266667485=14, srv1420125403=24, srv922542381=96, srv1463214933=26, srv794164448=91, srv1062005010=3, srv1999265678=53, srv73030378=88, srv1234988486=11, srv1781955382=41, srv1341711730=21, srv1916977548=49, srv401993062=73, srv1868401705=45, srv594448349=78, srv866707969=94, srv911090858=95, srv176800296=39, srv1692885859=34, srv290887630=65, srv932577419=97, srv254680750=63, srv214256325=60, srv703278845=84, srv654588509=81, srv1441856154=25, srv1041989920=2, srv1074808585=5, srv1893959344=48, srv1152225841=6, srv1846756741=44, srv123918442=13, srv1835266775=43, srv1496294939=27, srv260477232=64, srv564481136=76, srv1642709607=33, srv451663271=75, srv1302307276=19, srv338261570=69, srv345433051=70, srv195696742=52, srv789828428=90, srv1209285944=9, srv719424698=87, srv686667820=83, srv2111811135=58, srv2141163574=59, srv1286607652=16, srv1742450762=38, srv1542500382=30, srv1881807692=46, srv805567636=92, srv1234172651=10, srv1266874144=15, srv179716218=42, srv599225447=79, srv240535635=61, srv247824868=62, srv1942707100=50, srv1178099933=7, srv1694372103=35, srv2010252766=54, srv1513532862=28, srv2103688509=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:12,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:12,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:12,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 11:53:12,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 11:53:12,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 11:53:12,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 11:53:12,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 11:53:12,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 11:53:12,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 11:53:12,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038380525839564, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05809354274093672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038380525839564, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.238, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:12,932 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 11:53:12,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18190671432595146, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038380525839564, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05809354274093672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038380525839564, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.238, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 11:53:13,174 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 353 ms to try 5000 different iterations.  Found a solution that moves 2631 regions; Going from a computed imbalance of 0.18190671432595146 to a new imbalance of 0.01623754241502371. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023414161749787086); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036422511261571824, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023414161749787086); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:13,185 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1881807692:77 , srv866707969:79 , srv1420125403:80 , srv1595671959:81 , srv195696742:81 , srv937683361:81 , srv1341711730:82 , srv152233165:82 , srv1835266775:82 , srv2010252766:82 , srv2111811135:82 , srv1072842841:83 , srv1074808585:83 , srv1237210056:83 , srv1266667485:83 , srv1330536601:83 , srv1463214933:83 , srv1742450762:83 , srv654588509:83 , srv668570672:83 , srv713276190:83 , srv73030378:83 , srv794164448:83 , srv1041989920:84 , srv1195001775:84 , srv1234988486:84 , srv1286607652:84 , srv1287668514:84 , srv1302307276:84 , srv1642709607:84 , srv1781955382:84 , srv1883335406:84 , srv1942707100:84 , srv1999265678:84 , srv247824868:84 , srv301042146:84 , srv302671678:84 , srv388361600:84 , srv1178099933:85 , srv1292825720:85 , srv1740711358:85 , srv176800296:85 , srv1846756741:85 , srv2042283891:85 , srv214256325:85 , srv260477232:85 , srv290887630:85 , srv401993062:85 , srv451663271:85 , srv932577419:85 , srv1022293250:86 , srv1029454566:86 , srv1398714577:86 , srv1513532862:86 , srv1692885859:86 , srv1694372103:86 , srv179716218:86 , srv1893959344:86 , srv1916977548:86 , srv338261570:86 , srv564481136:86 , srv604407099:86 , srv686667820:86 , srv922542381:86 , srv949399562:86 , srv123918442:87 , srv1441856154:87 , srv1496294939:87 , srv1542500382:87 , srv1725177281:87 , srv1868401705:87 , srv2141163574:87 , srv307586931:87 , srv345433051:87 , srv411364397:87 , srv571825717:87 , srv712374344:87 , srv789828428:87 , srv822100083:87 , srv1209285944:88 , srv1266874144:88 , srv761140624:88 , srv1062005010:89 , srv1234172651:89 , srv134384270:89 , srv1561595578:89 , srv1944182289:89 , srv2037917946:89 , srv240535635:89 , srv254680750:89 , srv599225447:89 , srv805567636:89 , srv1152225841:90 , srv2103688509:90 , srv1781565892:91 , srv354911866:92 , srv719424698:92 , srv911090858:92 , srv594448349:93 , srv703278845:533 }
2024-02-07 11:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv937683361=98, srv713276190=86, srv1287668514=17, srv307586931=68, srv1398714577=23, srv1195001775=8, srv1072842841=4, srv134384270=22, srv1029454566=1, srv1725177281=36, srv1237210056=12, srv1561595578=31, srv949399562=99, srv301042146=66, srv1330536601=20, srv2037917946=55, srv1595671959=32, srv1883335406=47, srv354911866=71, srv302671678=67, srv152233165=29, srv388361600=72, srv2042283891=56, srv822100083=93, srv604407099=80, srv668570672=82, srv571825717=77, srv1944182289=51, srv1740711358=37, srv1781565892=40, srv712374344=85, srv1022293250=0, srv761140624=89, srv411364397=74, srv1292825720=18, srv1266667485=14, srv1420125403=24, srv922542381=96, srv1463214933=26, srv794164448=91, srv1062005010=3, srv1999265678=53, srv73030378=88, srv1234988486=11, srv1781955382=41, srv1341711730=21, srv1916977548=49, srv401993062=73, srv1868401705=45, srv594448349=78, srv866707969=94, srv911090858=95, srv176800296=39, srv1692885859=34, srv290887630=65, srv932577419=97, srv254680750=63, srv214256325=60, srv703278845=84, srv654588509=81, srv1441856154=25, srv1041989920=2, srv1074808585=5, srv1893959344=48, srv1152225841=6, srv1846756741=44, srv123918442=13, srv1835266775=43, srv1496294939=27, srv260477232=64, srv564481136=76, srv1642709607=33, srv451663271=75, srv1302307276=19, srv338261570=69, srv345433051=70, srv195696742=52, srv789828428=90, srv1209285944=9, srv719424698=87, srv686667820=83, srv2111811135=58, srv2141163574=59, srv1286607652=16, srv1742450762=38, srv1542500382=30, srv1881807692=46, srv805567636=92, srv1234172651=10, srv1266874144=15, srv179716218=42, srv599225447=79, srv240535635=61, srv247824868=62, srv1942707100=50, srv1178099933=7, srv1694372103=35, srv2010252766=54, srv1513532862=28, srv2103688509=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:13,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:13,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:13,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:13,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:13,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:13,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:13,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 11:53:13,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 11:53:13,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 11:53:13,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 11:53:13,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 11:53:13,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 11:53:13,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 11:53:13,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 11:53:13,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 11:53:13,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023414161749787086); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036422511261571824, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023414161749787086); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:13,370 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 11:53:13,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016219119759268395, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023414161749787086); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036422511261571824, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023414161749787086); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 11:53:13,685 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 457 ms to try 5000 different iterations.  Found a solution that moves 1004 regions; Going from a computed imbalance of 0.016219119759268395 to a new imbalance of 6.588456872121428E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007120714615156442); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008850929047597865); MoveCostFunction : (multiplier=7.0, imbalance=0.11155555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007120714615156442); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:13,687 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1846756741:81 , srv922542381:81 , srv911090858:82 , srv1062005010:83 , srv2037917946:83 , srv247824868:83 , srv354911866:83 , srv401993062:83 , srv594448349:83 , srv599225447:83 , srv604407099:83 , srv719424698:83 , srv789828428:83 , srv932577419:83 , srv1152225841:84 , srv123918442:84 , srv1292825720:84 , srv1330536601:84 , srv1441856154:84 , srv1740711358:84 , srv176800296:84 , srv1781565892:84 , srv240535635:84 , srv290887630:84 , srv301042146:84 , srv338261570:84 , srv345433051:84 , srv686667820:84 , srv712374344:84 , srv73030378:84 , srv1234988486:85 , srv1237210056:85 , srv1266667485:85 , srv134384270:85 , srv1398714577:85 , srv1420125403:85 , srv1513532862:85 , srv1542500382:85 , srv1692885859:85 , srv179716218:85 , srv1916977548:85 , srv195696742:85 , srv1999265678:85 , srv2010252766:85 , srv2042283891:85 , srv2103688509:85 , srv260477232:85 , srv761140624:85 , srv805567636:85 , srv1022293250:86 , srv1041989920:86 , srv1072842841:86 , srv1209285944:86 , srv1266874144:86 , srv1463214933:86 , srv1642709607:86 , srv1694372103:86 , srv1725177281:86 , srv1742450762:86 , srv1781955382:86 , srv1868401705:86 , srv1883335406:86 , srv1893959344:86 , srv1942707100:86 , srv1944182289:86 , srv2141163574:86 , srv254680750:86 , srv307586931:86 , srv388361600:86 , srv411364397:86 , srv564481136:86 , srv668570672:86 , srv937683361:86 , srv1029454566:87 , srv1178099933:87 , srv1195001775:87 , srv1234172651:87 , srv1286607652:87 , srv1302307276:87 , srv1561595578:87 , srv302671678:87 , srv451663271:87 , srv571825717:87 , srv794164448:87 , srv822100083:87 , srv866707969:87 , srv949399562:87 , srv1287668514:88 , srv1496294939:88 , srv152233165:88 , srv1881807692:88 , srv214256325:88 , srv654588509:88 , srv713276190:88 , srv1074808585:89 , srv1341711730:89 , srv1595671959:89 , srv1835266775:90 , srv2111811135:90 , srv703278845:539 }
2024-02-07 11:53:13,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:13,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv937683361=98, srv713276190=86, srv1287668514=17, srv307586931=68, srv1398714577=23, srv1195001775=8, srv1072842841=4, srv134384270=22, srv1029454566=1, srv1725177281=36, srv1237210056=12, srv1561595578=31, srv949399562=99, srv301042146=66, srv1330536601=20, srv2037917946=55, srv1595671959=32, srv1883335406=47, srv354911866=71, srv302671678=67, srv152233165=29, srv388361600=72, srv2042283891=56, srv822100083=93, srv604407099=80, srv668570672=82, srv571825717=77, srv1944182289=51, srv1740711358=37, srv1781565892=40, srv712374344=85, srv1022293250=0, srv761140624=89, srv411364397=74, srv1292825720=18, srv1266667485=14, srv1420125403=24, srv922542381=96, srv1463214933=26, srv794164448=91, srv1062005010=3, srv1999265678=53, srv73030378=88, srv1234988486=11, srv1781955382=41, srv1341711730=21, srv1916977548=49, srv401993062=73, srv1868401705=45, srv594448349=78, srv866707969=94, srv911090858=95, srv176800296=39, srv1692885859=34, srv290887630=65, srv932577419=97, srv254680750=63, srv214256325=60, srv703278845=84, srv654588509=81, srv1441856154=25, srv1041989920=2, srv1074808585=5, srv1893959344=48, srv1152225841=6, srv1846756741=44, srv123918442=13, srv1835266775=43, srv1496294939=27, srv260477232=64, srv564481136=76, srv1642709607=33, srv451663271=75, srv1302307276=19, srv338261570=69, srv345433051=70, srv195696742=52, srv789828428=90, srv1209285944=9, srv719424698=87, srv686667820=83, srv2111811135=58, srv2141163574=59, srv1286607652=16, srv1742450762=38, srv1542500382=30, srv1881807692=46, srv805567636=92, srv1234172651=10, srv1266874144=15, srv179716218=42, srv599225447=79, srv240535635=61, srv247824868=62, srv1942707100=50, srv1178099933=7, srv1694372103=35, srv2010252766=54, srv1513532862=28, srv2103688509=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:13,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:13,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:13,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 11:53:13,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 11:53:13,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 11:53:13,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 11:53:13,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 11:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 11:53:13,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 11:53:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 11:53:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 11:53:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 11:53:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 11:53:13,852 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007120714615156442); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008850929047597865); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007120714615156442); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:13,852 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 11:53:13,852 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.518155289535574E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007120714615156442); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008850929047597865); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007120714615156442); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 11:53:14,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 592 ms to try 5000 different iterations.  Found a solution that moves 264 regions; Going from a computed imbalance of 6.518155289535574E-4 to a new imbalance of 3.510445902374117E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.029333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:14,321 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1074808585:83 , srv1234172651:83 , srv1496294939:83 , srv1835266775:83 , srv1944182289:83 , srv564481136:83 , srv571825717:83 , srv794164448:83 , srv1041989920:84 , srv1234988486:84 , srv1237210056:84 , srv1287668514:84 , srv1341711730:84 , srv1398714577:84 , srv152233165:84 , srv1561595578:84 , srv1595671959:84 , srv1642709607:84 , srv1692885859:84 , srv1742450762:84 , srv1781565892:84 , srv179716218:84 , srv1846756741:84 , srv1893959344:84 , srv2010252766:84 , srv2103688509:84 , srv2141163574:84 , srv214256325:84 , srv254680750:84 , srv260477232:84 , srv302671678:84 , srv345433051:84 , srv388361600:84 , srv411364397:84 , srv451663271:84 , srv594448349:84 , srv686667820:84 , srv822100083:84 , srv866707969:84 , srv911090858:84 , srv937683361:84 , srv949399562:84 , srv1022293250:85 , srv1029454566:85 , srv1062005010:85 , srv1178099933:85 , srv1195001775:85 , srv1209285944:85 , srv123918442:85 , srv1266667485:85 , srv1286607652:85 , srv1292825720:85 , srv1302307276:85 , srv1330536601:85 , srv134384270:85 , srv1420125403:85 , srv1441856154:85 , srv1463214933:85 , srv1513532862:85 , srv1542500382:85 , srv1694372103:85 , srv1725177281:85 , srv1781955382:85 , srv1868401705:85 , srv1881807692:85 , srv1883335406:85 , srv1916977548:85 , srv1942707100:85 , srv195696742:85 , srv1999265678:85 , srv2037917946:85 , srv2042283891:85 , srv2111811135:85 , srv240535635:85 , srv247824868:85 , srv290887630:85 , srv354911866:85 , srv401993062:85 , srv604407099:85 , srv654588509:85 , srv712374344:85 , srv713276190:85 , srv719424698:85 , srv73030378:85 , srv761140624:85 , srv805567636:85 , srv1072842841:86 , srv1152225841:86 , srv1266874144:86 , srv1740711358:86 , srv176800296:86 , srv301042146:86 , srv307586931:86 , srv338261570:86 , srv599225447:86 , srv668570672:86 , srv789828428:86 , srv932577419:86 , srv922542381:87 , srv703278845:621 }
2024-02-07 11:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv937683361=98, srv713276190=86, srv1287668514=17, srv307586931=68, srv1398714577=23, srv1195001775=8, srv1072842841=4, srv134384270=22, srv1029454566=1, srv1725177281=36, srv1237210056=12, srv1561595578=31, srv949399562=99, srv301042146=66, srv1330536601=20, srv2037917946=55, srv1595671959=32, srv1883335406=47, srv354911866=71, srv302671678=67, srv152233165=29, srv388361600=72, srv2042283891=56, srv822100083=93, srv604407099=80, srv668570672=82, srv571825717=77, srv1944182289=51, srv1740711358=37, srv1781565892=40, srv712374344=85, srv1022293250=0, srv761140624=89, srv411364397=74, srv1292825720=18, srv1266667485=14, srv1420125403=24, srv922542381=96, srv1463214933=26, srv794164448=91, srv1062005010=3, srv1999265678=53, srv73030378=88, srv1234988486=11, srv1781955382=41, srv1341711730=21, srv1916977548=49, srv401993062=73, srv1868401705=45, srv594448349=78, srv866707969=94, srv911090858=95, srv176800296=39, srv1692885859=34, srv290887630=65, srv932577419=97, srv254680750=63, srv214256325=60, srv703278845=84, srv654588509=81, srv1441856154=25, srv1041989920=2, srv1074808585=5, srv1893959344=48, srv1152225841=6, srv1846756741=44, srv123918442=13, srv1835266775=43, srv1496294939=27, srv260477232=64, srv564481136=76, srv1642709607=33, srv451663271=75, srv1302307276=19, srv338261570=69, srv345433051=70, srv195696742=52, srv789828428=90, srv1209285944=9, srv719424698=87, srv686667820=83, srv2111811135=58, srv2141163574=59, srv1286607652=16, srv1742450762=38, srv1542500382=30, srv1881807692=46, srv805567636=92, srv1234172651=10, srv1266874144=15, srv179716218=42, srv599225447=79, srv240535635=61, srv247824868=62, srv1942707100=50, srv1178099933=7, srv1694372103=35, srv2010252766=54, srv1513532862=28, srv2103688509=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:14,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:14,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:14,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:14,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:14,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:14,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 11:53:14,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 11:53:14,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 11:53:14,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 11:53:14,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 11:53:14,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 11:53:14,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 11:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 11:53:14,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 11:53:14,478 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:14,478 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-07 11:53:14,479 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.325589151351553E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-07 11:53:14,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 387 ms to try 5000 different iterations.  Found a solution that moves 26 regions; Going from a computed imbalance of 3.325589151351553E-5 to a new imbalance of 6.580041563428285E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0028888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:14,758 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1266874144:83 , srv1292825720:83 , srv176800296:83 , srv789828428:83 , srv922542381:83 , srv1022293250:84 , srv1029454566:84 , srv1041989920:84 , srv1062005010:84 , srv1072842841:84 , srv1074808585:84 , srv1152225841:84 , srv1178099933:84 , srv1195001775:84 , srv1209285944:84 , srv1234172651:84 , srv1234988486:84 , srv123918442:84 , srv1266667485:84 , srv1286607652:84 , srv1287668514:84 , srv1302307276:84 , srv1330536601:84 , srv1341711730:84 , srv134384270:84 , srv1398714577:84 , srv1420125403:84 , srv1441856154:84 , srv1463214933:84 , srv1496294939:84 , srv152233165:84 , srv1542500382:84 , srv1561595578:84 , srv1595671959:84 , srv1642709607:84 , srv1692885859:84 , srv1694372103:84 , srv1725177281:84 , srv1740711358:84 , srv1742450762:84 , srv1781565892:84 , srv1781955382:84 , srv179716218:84 , srv1835266775:84 , srv1868401705:84 , srv1881807692:84 , srv1883335406:84 , srv1893959344:84 , srv1916977548:84 , srv1942707100:84 , srv1944182289:84 , srv195696742:84 , srv1999265678:84 , srv2010252766:84 , srv2037917946:84 , srv2042283891:84 , srv2103688509:84 , srv2111811135:84 , srv2141163574:84 , srv214256325:84 , srv240535635:84 , srv247824868:84 , srv254680750:84 , srv260477232:84 , srv290887630:84 , srv301042146:84 , srv302671678:84 , srv307586931:84 , srv338261570:84 , srv345433051:84 , srv354911866:84 , srv388361600:84 , srv401993062:84 , srv411364397:84 , srv451663271:84 , srv571825717:84 , srv594448349:84 , srv599225447:84 , srv604407099:84 , srv654588509:84 , srv668570672:84 , srv686667820:84 , srv712374344:84 , srv713276190:84 , srv719424698:84 , srv73030378:84 , srv761140624:84 , srv805567636:84 , srv822100083:84 , srv866707969:84 , srv911090858:84 , srv932577419:84 , srv937683361:84 , srv949399562:84 , srv1237210056:85 , srv1513532862:85 , srv1846756741:85 , srv564481136:85 , srv794164448:85 , srv703278845:684 }
2024-02-07 11:53:14,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv937683361=98, srv713276190=86, srv1287668514=17, srv307586931=68, srv1398714577=23, srv1195001775=8, srv1072842841=4, srv134384270=22, srv1029454566=1, srv1725177281=36, srv1237210056=12, srv1561595578=31, srv949399562=99, srv301042146=66, srv1330536601=20, srv2037917946=55, srv1595671959=32, srv1883335406=47, srv354911866=71, srv302671678=67, srv152233165=29, srv388361600=72, srv2042283891=56, srv822100083=93, srv604407099=80, srv668570672=82, srv571825717=77, srv1944182289=51, srv1740711358=37, srv1781565892=40, srv712374344=85, srv1022293250=0, srv761140624=89, srv411364397=74, srv1292825720=18, srv1266667485=14, srv1420125403=24, srv922542381=96, srv1463214933=26, srv794164448=91, srv1062005010=3, srv1999265678=53, srv73030378=88, srv1234988486=11, srv1781955382=41, srv1341711730=21, srv1916977548=49, srv401993062=73, srv1868401705=45, srv594448349=78, srv866707969=94, srv911090858=95, srv176800296=39, srv1692885859=34, srv290887630=65, srv932577419=97, srv254680750=63, srv214256325=60, srv703278845=84, srv654588509=81, srv1441856154=25, srv1041989920=2, srv1074808585=5, srv1893959344=48, srv1152225841=6, srv1846756741=44, srv123918442=13, srv1835266775=43, srv1496294939=27, srv260477232=64, srv564481136=76, srv1642709607=33, srv451663271=75, srv1302307276=19, srv338261570=69, srv345433051=70, srv195696742=52, srv789828428=90, srv1209285944=9, srv719424698=87, srv686667820=83, srv2111811135=58, srv2141163574=59, srv1286607652=16, srv1742450762=38, srv1542500382=30, srv1881807692=46, srv805567636=92, srv1234172651=10, srv1266874144=15, srv179716218=42, srv599225447=79, srv240535635=61, srv247824868=62, srv1942707100=50, srv1178099933=7, srv1694372103=35, srv2010252766=54, srv1513532862=28, srv2103688509=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-07 11:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-07 11:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-07 11:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-07 11:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-07 11:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-07 11:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-07 11:53:14,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-07 11:53:14,897 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:14,897 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1266874144:83 , srv1292825720:83 , srv176800296:83 , srv789828428:83 , srv922542381:83 , srv1022293250:84 , srv1029454566:84 , srv1041989920:84 , srv1062005010:84 , srv1072842841:84 , srv1074808585:84 , srv1152225841:84 , srv1178099933:84 , srv1195001775:84 , srv1209285944:84 , srv1234172651:84 , srv1234988486:84 , srv123918442:84 , srv1266667485:84 , srv1286607652:84 , srv1287668514:84 , srv1302307276:84 , srv1330536601:84 , srv1341711730:84 , srv134384270:84 , srv1398714577:84 , srv1420125403:84 , srv1441856154:84 , srv1463214933:84 , srv1496294939:84 , srv152233165:84 , srv1542500382:84 , srv1561595578:84 , srv1595671959:84 , srv1642709607:84 , srv1692885859:84 , srv1694372103:84 , srv1725177281:84 , srv1740711358:84 , srv1742450762:84 , srv1781565892:84 , srv1781955382:84 , srv179716218:84 , srv1835266775:84 , srv1868401705:84 , srv1881807692:84 , srv1883335406:84 , srv1893959344:84 , srv1916977548:84 , srv1942707100:84 , srv1944182289:84 , srv195696742:84 , srv1999265678:84 , srv2010252766:84 , srv2037917946:84 , srv2042283891:84 , srv2103688509:84 , srv2111811135:84 , srv2141163574:84 , srv214256325:84 , srv240535635:84 , srv247824868:84 , srv254680750:84 , srv260477232:84 , srv290887630:84 , srv301042146:84 , srv302671678:84 , srv307586931:84 , srv338261570:84 , srv345433051:84 , srv354911866:84 , srv388361600:84 , srv401993062:84 , srv411364397:84 , srv451663271:84 , srv571825717:84 , srv594448349:84 , srv599225447:84 , srv604407099:84 , srv654588509:84 , srv668570672:84 , srv686667820:84 , srv712374344:84 , srv713276190:84 , srv719424698:84 , srv73030378:84 , srv761140624:84 , srv805567636:84 , srv822100083:84 , srv866707969:84 , srv911090858:84 , srv932577419:84 , srv937683361:84 , srv949399562:84 , srv1237210056:85 , srv1513532862:85 , srv1846756741:85 , srv564481136:85 , srv794164448:85 , srv703278845:684 }
2024-02-07 11:53:14,925 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 306), ProcessCount=167 (was 167), AvailableMemoryMB=2706 (was 3639)
2024-02-07 11:53:14,934 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=167, AvailableMemoryMB=2705
2024-02-07 11:53:14,935 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-07 11:53:14,935 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-07 11:53:14,947 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022775545:84 , srv1082811458:84 , srv1129246664:84 , srv141375329:84 , srv1430345541:84 , srv1574907458:84 , srv1614139137:84 , srv1655205894:84 , srv1669311601:84 , srv1721077029:84 , srv1730214467:84 , srv1736131639:84 , srv1736661542:84 , srv1808938917:84 , srv1851571801:84 , srv1857144491:84 , srv1967639701:84 , srv354881029:84 , srv380876153:84 , srv386267288:84 , srv428561274:84 , srv463520732:84 , srv505930446:84 , srv519480362:84 , srv605658532:84 , srv767915871:84 , srv871641447:84 , srv977762720:84 , srv978642088:84 , srv824645302:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-07 11:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1655205894=7, srv605658532=24, srv1808938917=13, srv1574907458=5, srv1129246664=2, srv1967639701=16, srv767915871=25, srv1669311601=8, srv824645302=26, srv380876153=18, srv463520732=21, srv1082811458=1, srv1614139137=6, srv977762720=28, srv871641447=27, srv354881029=17, srv386267288=19, srv1851571801=14, srv1736661542=12, srv1022775545=0, srv519480362=23, srv1857144491=15, srv978642088=29, srv141375329=3, srv1430345541=4, srv1730214467=10, srv505930446=22, srv1736131639=11, srv1721077029=9, srv428561274=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:53:14,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:53:14,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:53:14,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:53:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:53:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-07 11:53:14,987 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1286099938720509, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:53:14,987 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912598289155468, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1286099938720509, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-07 11:55:14,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6439518 different iterations.  Found a solution that moves 1843 regions; Going from a computed imbalance of 0.9912598289155468 to a new imbalance of 4.3016539410932495E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6825925925925926, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:55:14,974 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1022775545:90 , srv1082811458:90 , srv1129246664:90 , srv141375329:90 , srv1430345541:90 , srv1574907458:90 , srv1614139137:90 , srv1655205894:90 , srv1669311601:90 , srv1721077029:90 , srv1730214467:90 , srv1736131639:90 , srv1736661542:90 , srv1808938917:90 , srv1851571801:90 , srv1857144491:90 , srv1967639701:90 , srv354881029:90 , srv380876153:90 , srv386267288:90 , srv428561274:90 , srv463520732:90 , srv505930446:90 , srv519480362:90 , srv605658532:90 , srv767915871:90 , srv824645302:90 , srv871641447:90 , srv977762720:90 , srv978642088:90 }
2024-02-07 11:55:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-07 11:55:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1655205894=7, srv605658532=24, srv1808938917=13, srv1574907458=5, srv1129246664=2, srv1967639701=16, srv767915871=25, srv1669311601=8, srv824645302=26, srv380876153=18, srv463520732=21, srv1082811458=1, srv1614139137=6, srv977762720=28, srv871641447=27, srv354881029=17, srv386267288=19, srv1851571801=14, srv1736661542=12, srv1022775545=0, srv519480362=23, srv1857144491=15, srv978642088=29, srv141375329=3, srv1430345541=4, srv1730214467=10, srv505930446=22, srv1736131639=11, srv1721077029=9, srv428561274=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-07 11:55:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-07 11:55:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-07 11:55:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-07 11:55:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-07 11:55:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-07 11:55:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-07 11:55:14,995 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-07 11:55:14,995 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1022775545:90 , srv1082811458:90 , srv1129246664:90 , srv141375329:90 , srv1430345541:90 , srv1574907458:90 , srv1614139137:90 , srv1655205894:90 , srv1669311601:90 , srv1721077029:90 , srv1730214467:90 , srv1736131639:90 , srv1736661542:90 , srv1808938917:90 , srv1851571801:90 , srv1857144491:90 , srv1967639701:90 , srv354881029:90 , srv380876153:90 , srv386267288:90 , srv428561274:90 , srv463520732:90 , srv505930446:90 , srv519480362:90 , srv605658532:90 , srv767915871:90 , srv824645302:90 , srv871641447:90 , srv977762720:90 , srv978642088:90 }
2024-02-07 11:55:15,012 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 306), ProcessCount=167 (was 167), AvailableMemoryMB=2533 (was 2705)