2024-02-24 14:53:15,240 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-24 14:53:15,579 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-24 14:53:15,698 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-24 14:53:15,762 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-24 14:53:15,772 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-24 14:53:15,789 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=167, AvailableMemoryMB=4445
2024-02-24 14:53:15,791 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-24 14:53:15,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-24 14:53:15,912 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1027172907:84 , srv1047052131:84 , srv1079659558:84 , srv1098044148:84 , srv1161032851:84 , srv1174460868:84 , srv1186158992:84 , srv121907193:84 , srv1273202537:84 , srv1287717495:84 , srv1319446082:84 , srv1320041736:84 , srv1337764081:84 , srv1384418486:84 , srv1388896053:84 , srv1389729154:84 , srv1392141136:84 , srv1415428439:84 , srv14400937:84 , srv1450503197:84 , srv1453376961:84 , srv1454144295:84 , srv1456606621:84 , srv1514230095:84 , srv1514929913:84 , srv152132424:84 , srv1526000466:84 , srv1539475972:84 , srv1562455973:84 , srv1586312364:84 , srv1589454527:84 , srv1607952922:84 , srv1628377461:84 , srv1630732639:84 , srv1634440006:84 , srv163977208:84 , srv1674773673:84 , srv168212928:84 , srv1682709146:84 , srv1686573947:84 , srv1727605660:84 , srv1768192471:84 , srv1792335127:84 , srv1835412331:84 , srv1840160441:84 , srv1871444067:84 , srv1872597659:84 , srv1873932658:84 , srv1950775353:84 , srv1988221724:84 , srv1992625688:84 , srv201854978:84 , srv2028994761:84 , srv2046097457:84 , srv2087446407:84 , srv2136449210:84 , srv225502734:84 , srv244632345:84 , srv245683816:84 , srv249216436:84 , srv260489261:84 , srv276333162:84 , srv285832957:84 , srv322052273:84 , srv353983978:84 , srv377592329:84 , srv379046740:84 , srv417751336:84 , srv428604650:84 , srv440699545:84 , srv447027297:84 , srv455770749:84 , srv487539767:84 , srv490337843:84 , srv494686716:84 , srv512980327:84 , srv53002932:84 , srv542943937:84 , srv552687691:84 , srv555927760:84 , srv591425170:84 , srv59178753:84 , srv628093790:84 , srv63125873:84 , srv671476886:84 , srv707511293:84 , srv711191527:84 , srv712925184:84 , srv715751694:84 , srv762108432:84 , srv762901633:84 , srv781966010:84 , srv824255953:84 , srv850808935:84 , srv859061225:84 , srv878659983:84 , srv928165271:84 , srv938050634:84 , srv998985717:84 , srv1884249884:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-24 14:53:15,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2087446407=55, srv163977208=35, srv59178753=82, srv322052273=64, srv928165271=97, srv1872597659=46, srv276333162=62, srv762901633=91, srv1992625688=51, srv1319446082=10, srv850808935=94, srv260489261=61, srv1674773673=36, srv1950775353=49, srv1186158992=6, srv1320041736=11, srv225502734=57, srv244632345=58, srv1454144295=21, srv2046097457=54, srv1273202537=8, srv998985717=99, srv201854978=52, srv1562455973=28, srv377592329=66, srv1884249884=48, srv1539475972=27, srv1098044148=3, srv591425170=81, srv1161032851=4, srv1453376961=20, srv552687691=79, srv707511293=86, srv824255953=93, srv1392141136=16, srv417751336=68, srv168212928=37, srv1682709146=38, srv245683816=59, srv671476886=85, srv1450503197=19, srv1514929913=24, srv1628377461=32, srv121907193=7, srv628093790=83, srv63125873=84, srv1287717495=9, srv512980327=76, srv781966010=92, srv542943937=78, srv1456606621=22, srv1047052131=1, srv487539767=73, srv1079659558=2, srv428604650=69, srv1686573947=39, srv1526000466=26, srv1514230095=23, srv152132424=25, srv1634440006=34, srv353983978=65, srv1174460868=5, srv1768192471=41, srv249216436=60, srv859061225=95, srv2028994761=53, srv1337764081=12, srv494686716=75, srv285832957=63, srv447027297=71, srv440699545=70, srv1586312364=29, srv1388896053=14, srv1727605660=40, srv455770749=72, srv762108432=90, srv14400937=18, srv1607952922=31, srv712925184=88, srv490337843=74, srv1630732639=33, srv1792335127=42, srv379046740=67, srv555927760=80, srv1389729154=15, srv2136449210=56, srv711191527=87, srv53002932=77, srv1835412331=43, srv1873932658=47, srv1384418486=13, srv938050634=98, srv1415428439=17, srv1988221724=50, srv715751694=89, srv1871444067=45, srv1027172907=0, srv1589454527=30, srv878659983=96, srv1840160441=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:16,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:16,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:16,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:16,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:16,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:16,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:16,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:16,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:16,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:16,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:16,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:16,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:16,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:16,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:16,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:16,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:16,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:16,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:16,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:16,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:16,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:16,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:16,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:16,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:16,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-24 14:53:16,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-24 14:53:16,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-24 14:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-24 14:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-24 14:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-24 14:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-24 14:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-24 14:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-24 14:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-24 14:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-24 14:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-24 14:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-24 14:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-24 14:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-24 14:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-24 14:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-24 14:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-24 14:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-24 14:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-24 14:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-24 14:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-24 14:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-24 14:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-24 14:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-24 14:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-24 14:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-24 14:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-24 14:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-24 14:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-24 14:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-24 14:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-24 14:53:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-24 14:53:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-24 14:53:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-24 14:53:16,277 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:16,277 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-24 14:53:16,278 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-24 14:53:16,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 544 ms to try 5000 different iterations.  Found a solution that moves 4682 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18128848893950014. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04053206428792923, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05664388529985452, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5202222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04053206428792923, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1765, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:16,652 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1098044148:82 , srv1161032851:82 , srv1630732639:82 , srv1988221724:82 , srv1992625688:82 , srv201854978:82 , srv276333162:82 , srv490337843:82 , srv494686716:82 , srv671476886:82 , srv928165271:82 , srv1586312364:83 , srv1607952922:83 , srv1727605660:83 , srv2028994761:83 , srv1047052131:84 , srv1079659558:84 , srv1186158992:84 , srv1388896053:84 , srv163977208:84 , srv1682709146:84 , srv1768192471:84 , srv1835412331:84 , srv1873932658:84 , srv1950775353:84 , srv762901633:84 , srv998985717:84 , srv1174460868:85 , srv121907193:85 , srv1273202537:85 , srv1287717495:85 , srv1526000466:85 , srv1562455973:85 , srv1628377461:85 , srv225502734:85 , srv440699545:85 , srv512980327:85 , srv555927760:85 , srv824255953:85 , srv859061225:85 , srv878659983:85 , srv1384418486:86 , srv1389729154:86 , srv1454144295:86 , srv1514230095:86 , srv1589454527:86 , srv1686573947:86 , srv260489261:86 , srv377592329:86 , srv379046740:86 , srv428604650:86 , srv552687691:86 , srv628093790:86 , srv711191527:86 , srv715751694:86 , srv1320041736:87 , srv1337764081:87 , srv1415428439:87 , srv1514929913:87 , srv1539475972:87 , srv168212928:87 , srv1872597659:87 , srv2087446407:87 , srv244632345:87 , srv322052273:87 , srv487539767:87 , srv591425170:87 , srv59178753:87 , srv762108432:87 , srv1453376961:88 , srv1674773673:88 , srv1792335127:88 , srv2136449210:88 , srv245683816:88 , srv285832957:88 , srv447027297:88 , srv63125873:88 , srv707511293:88 , srv850808935:88 , srv1319446082:89 , srv1450503197:89 , srv1456606621:89 , srv2046097457:89 , srv781966010:89 , srv1392141136:90 , srv14400937:90 , srv1634440006:90 , srv1871444067:90 , srv417751336:90 , srv938050634:90 , srv1027172907:91 , srv353983978:91 , srv542943937:91 , srv712925184:91 , srv1840160441:93 , srv455770749:93 , srv53002932:93 , srv152132424:94 , srv249216436:94 , srv1884249884:450 }
2024-02-24 14:53:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2087446407=55, srv163977208=35, srv59178753=82, srv322052273=64, srv928165271=97, srv1872597659=46, srv276333162=62, srv762901633=91, srv1992625688=51, srv1319446082=10, srv850808935=94, srv260489261=61, srv1674773673=36, srv1950775353=49, srv1186158992=6, srv1320041736=11, srv225502734=57, srv244632345=58, srv1454144295=21, srv2046097457=54, srv1273202537=8, srv998985717=99, srv201854978=52, srv1562455973=28, srv377592329=66, srv1884249884=48, srv1539475972=27, srv1098044148=3, srv591425170=81, srv1161032851=4, srv1453376961=20, srv552687691=79, srv707511293=86, srv824255953=93, srv1392141136=16, srv417751336=68, srv168212928=37, srv1682709146=38, srv245683816=59, srv671476886=85, srv1450503197=19, srv1514929913=24, srv1628377461=32, srv121907193=7, srv628093790=83, srv63125873=84, srv1287717495=9, srv512980327=76, srv781966010=92, srv542943937=78, srv1456606621=22, srv1047052131=1, srv487539767=73, srv1079659558=2, srv428604650=69, srv1686573947=39, srv1526000466=26, srv1514230095=23, srv152132424=25, srv1634440006=34, srv353983978=65, srv1174460868=5, srv1768192471=41, srv249216436=60, srv859061225=95, srv2028994761=53, srv1337764081=12, srv494686716=75, srv285832957=63, srv447027297=71, srv440699545=70, srv1586312364=29, srv1388896053=14, srv1727605660=40, srv455770749=72, srv762108432=90, srv14400937=18, srv1607952922=31, srv712925184=88, srv490337843=74, srv1630732639=33, srv1792335127=42, srv379046740=67, srv555927760=80, srv1389729154=15, srv2136449210=56, srv711191527=87, srv53002932=77, srv1835412331=43, srv1873932658=47, srv1384418486=13, srv938050634=98, srv1415428439=17, srv1988221724=50, srv715751694=89, srv1871444067=45, srv1027172907=0, srv1589454527=30, srv878659983=96, srv1840160441=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-24 14:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-24 14:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-24 14:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-24 14:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-24 14:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-24 14:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-24 14:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-24 14:53:16,844 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04053206428792923, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05664388529985452, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04053206428792923, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1765, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:16,844 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-24 14:53:16,845 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18125570487479226, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04053206428792923, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05664388529985452, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04053206428792923, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1765, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-24 14:53:17,168 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 455 ms to try 5000 different iterations.  Found a solution that moves 2721 regions; Going from a computed imbalance of 0.18125570487479226 to a new imbalance of 0.014675031077950878. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02137964949771086); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02967462912854931, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30233333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02137964949771086); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:17,190 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv152132424:79 , srv249216436:79 , srv455770749:79 , srv53002932:79 , srv542943937:79 , srv1456606621:80 , srv1027172907:81 , srv14400937:81 , srv1840160441:81 , srv938050634:81 , srv1319446082:82 , srv1392141136:82 , srv1514929913:82 , srv1634440006:82 , srv168212928:82 , srv353983978:82 , srv417751336:82 , srv1450503197:83 , srv1453376961:83 , srv1539475972:83 , srv1674773673:83 , srv1871444067:83 , srv2046097457:83 , srv245683816:83 , srv285832957:83 , srv447027297:83 , srv712925184:83 , srv1320041736:84 , srv1337764081:84 , srv1792335127:84 , srv2136449210:84 , srv322052273:84 , srv707511293:84 , srv762901633:84 , srv781966010:84 , srv1384418486:85 , srv1415428439:85 , srv1454144295:85 , srv1686573947:85 , srv1872597659:85 , srv2087446407:85 , srv244632345:85 , srv428604650:85 , srv63125873:85 , srv711191527:85 , srv715751694:85 , srv1514230095:86 , srv1589454527:86 , srv377592329:86 , srv379046740:86 , srv555927760:86 , srv591425170:86 , srv59178753:86 , srv762108432:86 , srv824255953:86 , srv1047052131:87 , srv1186158992:87 , srv1526000466:87 , srv1682709146:87 , srv1727605660:87 , srv440699545:87 , srv487539767:87 , srv512980327:87 , srv628093790:87 , srv850808935:87 , srv1079659558:88 , srv1273202537:88 , srv1389729154:88 , srv1628377461:88 , srv1873932658:88 , srv1950775353:88 , srv2028994761:88 , srv225502734:88 , srv552687691:88 , srv1161032851:89 , srv121907193:89 , srv1287717495:89 , srv1562455973:89 , srv1607952922:89 , srv1630732639:89 , srv1992625688:89 , srv201854978:89 , srv260489261:89 , srv490337843:89 , srv859061225:89 , srv878659983:89 , srv1098044148:90 , srv1174460868:90 , srv1388896053:90 , srv1586312364:90 , srv163977208:90 , srv1768192471:90 , srv1835412331:90 , srv1988221724:90 , srv276333162:90 , srv494686716:90 , srv928165271:90 , srv671476886:91 , srv998985717:91 , srv1884249884:514 }
2024-02-24 14:53:17,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:17,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2087446407=55, srv163977208=35, srv59178753=82, srv322052273=64, srv928165271=97, srv1872597659=46, srv276333162=62, srv762901633=91, srv1992625688=51, srv1319446082=10, srv850808935=94, srv260489261=61, srv1674773673=36, srv1950775353=49, srv1186158992=6, srv1320041736=11, srv225502734=57, srv244632345=58, srv1454144295=21, srv2046097457=54, srv1273202537=8, srv998985717=99, srv201854978=52, srv1562455973=28, srv377592329=66, srv1884249884=48, srv1539475972=27, srv1098044148=3, srv591425170=81, srv1161032851=4, srv1453376961=20, srv552687691=79, srv707511293=86, srv824255953=93, srv1392141136=16, srv417751336=68, srv168212928=37, srv1682709146=38, srv245683816=59, srv671476886=85, srv1450503197=19, srv1514929913=24, srv1628377461=32, srv121907193=7, srv628093790=83, srv63125873=84, srv1287717495=9, srv512980327=76, srv781966010=92, srv542943937=78, srv1456606621=22, srv1047052131=1, srv487539767=73, srv1079659558=2, srv428604650=69, srv1686573947=39, srv1526000466=26, srv1514230095=23, srv152132424=25, srv1634440006=34, srv353983978=65, srv1174460868=5, srv1768192471=41, srv249216436=60, srv859061225=95, srv2028994761=53, srv1337764081=12, srv494686716=75, srv285832957=63, srv447027297=71, srv440699545=70, srv1586312364=29, srv1388896053=14, srv1727605660=40, srv455770749=72, srv762108432=90, srv14400937=18, srv1607952922=31, srv712925184=88, srv490337843=74, srv1630732639=33, srv1792335127=42, srv379046740=67, srv555927760=80, srv1389729154=15, srv2136449210=56, srv711191527=87, srv53002932=77, srv1835412331=43, srv1873932658=47, srv1384418486=13, srv938050634=98, srv1415428439=17, srv1988221724=50, srv715751694=89, srv1871444067=45, srv1027172907=0, srv1589454527=30, srv878659983=96, srv1840160441=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-24 14:53:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-24 14:53:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-24 14:53:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-24 14:53:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-24 14:53:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-24 14:53:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-24 14:53:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-24 14:53:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-24 14:53:17,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02137964949771086); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02967462912854931, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02137964949771086); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:17,417 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-24 14:53:17,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01465597822872617, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02137964949771086); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02967462912854931, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02137964949771086); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-24 14:53:17,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 601 ms to try 5000 different iterations.  Found a solution that moves 1005 regions; Going from a computed imbalance of 0.01465597822872617 to a new imbalance of 5.087945015639768E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054295474061417486); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007324451309205374); MoveCostFunction : (multiplier=7.0, imbalance=0.11166666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054295474061417486); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:17,882 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1174460868:83 , srv1562455973:83 , srv1768192471:83 , srv260489261:83 , srv850808935:83 , srv878659983:83 , srv998985717:83 , srv1287717495:84 , srv1388896053:84 , srv1389729154:84 , srv1586312364:84 , srv163977208:84 , srv1835412331:84 , srv1840160441:84 , srv1871444067:84 , srv249216436:84 , srv353983978:84 , srv487539767:84 , srv552687691:84 , srv628093790:84 , srv671476886:84 , srv712925184:84 , srv762108432:84 , srv781966010:84 , srv859061225:84 , srv1027172907:85 , srv1098044148:85 , srv121907193:85 , srv1273202537:85 , srv1392141136:85 , srv1450503197:85 , srv1453376961:85 , srv1514230095:85 , srv152132424:85 , srv1526000466:85 , srv1607952922:85 , srv1628377461:85 , srv1873932658:85 , srv1950775353:85 , srv2136449210:85 , srv225502734:85 , srv244632345:85 , srv276333162:85 , srv377592329:85 , srv417751336:85 , srv494686716:85 , srv512980327:85 , srv591425170:85 , srv59178753:85 , srv63125873:85 , srv928165271:85 , srv1079659558:86 , srv1161032851:86 , srv1186158992:86 , srv1319446082:86 , srv1320041736:86 , srv1415428439:86 , srv14400937:86 , srv1454144295:86 , srv1589454527:86 , srv1630732639:86 , srv1634440006:86 , srv1674773673:86 , srv1686573947:86 , srv1792335127:86 , srv1872597659:86 , srv1988221724:86 , srv1992625688:86 , srv201854978:86 , srv2028994761:86 , srv2046097457:86 , srv285832957:86 , srv322052273:86 , srv440699545:86 , srv447027297:86 , srv455770749:86 , srv490337843:86 , srv53002932:86 , srv555927760:86 , srv707511293:86 , srv824255953:86 , srv1047052131:87 , srv1337764081:87 , srv1384418486:87 , srv1539475972:87 , srv1727605660:87 , srv2087446407:87 , srv379046740:87 , srv428604650:87 , srv542943937:87 , srv711191527:87 , srv715751694:87 , srv938050634:87 , srv1456606621:88 , srv168212928:88 , srv1682709146:88 , srv245683816:88 , srv1514929913:89 , srv762901633:90 , srv1884249884:542 }
2024-02-24 14:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:17,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2087446407=55, srv163977208=35, srv59178753=82, srv322052273=64, srv928165271=97, srv1872597659=46, srv276333162=62, srv762901633=91, srv1992625688=51, srv1319446082=10, srv850808935=94, srv260489261=61, srv1674773673=36, srv1950775353=49, srv1186158992=6, srv1320041736=11, srv225502734=57, srv244632345=58, srv1454144295=21, srv2046097457=54, srv1273202537=8, srv998985717=99, srv201854978=52, srv1562455973=28, srv377592329=66, srv1884249884=48, srv1539475972=27, srv1098044148=3, srv591425170=81, srv1161032851=4, srv1453376961=20, srv552687691=79, srv707511293=86, srv824255953=93, srv1392141136=16, srv417751336=68, srv168212928=37, srv1682709146=38, srv245683816=59, srv671476886=85, srv1450503197=19, srv1514929913=24, srv1628377461=32, srv121907193=7, srv628093790=83, srv63125873=84, srv1287717495=9, srv512980327=76, srv781966010=92, srv542943937=78, srv1456606621=22, srv1047052131=1, srv487539767=73, srv1079659558=2, srv428604650=69, srv1686573947=39, srv1526000466=26, srv1514230095=23, srv152132424=25, srv1634440006=34, srv353983978=65, srv1174460868=5, srv1768192471=41, srv249216436=60, srv859061225=95, srv2028994761=53, srv1337764081=12, srv494686716=75, srv285832957=63, srv447027297=71, srv440699545=70, srv1586312364=29, srv1388896053=14, srv1727605660=40, srv455770749=72, srv762108432=90, srv14400937=18, srv1607952922=31, srv712925184=88, srv490337843=74, srv1630732639=33, srv1792335127=42, srv379046740=67, srv555927760=80, srv1389729154=15, srv2136449210=56, srv711191527=87, srv53002932=77, srv1835412331=43, srv1873932658=47, srv1384418486=13, srv938050634=98, srv1415428439=17, srv1988221724=50, srv715751694=89, srv1871444067=45, srv1027172907=0, srv1589454527=30, srv878659983=96, srv1840160441=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:17,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:17,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:17,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-24 14:53:17,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-24 14:53:17,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-24 14:53:17,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-24 14:53:17,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-24 14:53:17,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-24 14:53:17,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-24 14:53:17,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-24 14:53:17,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-24 14:53:17,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-24 14:53:17,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-24 14:53:17,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-24 14:53:18,073 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054295474061417486); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007324451309205374); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054295474061417486); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:18,073 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-24 14:53:18,074 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.017573411557315E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054295474061417486); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007324451309205374); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054295474061417486); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-24 14:53:18,354 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 423 ms to try 5000 different iterations.  Found a solution that moves 215 regions; Going from a computed imbalance of 5.017573411557315E-4 to a new imbalance of 2.6211979559099413E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.02388888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:18,355 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv121907193:83 , srv1628377461:83 , srv1682709146:83 , srv1840160441:83 , srv2087446407:83 , srv245683816:83 , srv379046740:83 , srv1047052131:84 , srv1174460868:84 , srv1273202537:84 , srv1287717495:84 , srv1337764081:84 , srv1384418486:84 , srv1388896053:84 , srv1389729154:84 , srv1415428439:84 , srv1514230095:84 , srv1514929913:84 , srv152132424:84 , srv1526000466:84 , srv1589454527:84 , srv1634440006:84 , srv163977208:84 , srv1792335127:84 , srv1835412331:84 , srv1872597659:84 , srv1988221724:84 , srv2046097457:84 , srv225502734:84 , srv260489261:84 , srv440699545:84 , srv455770749:84 , srv494686716:84 , srv53002932:84 , srv552687691:84 , srv591425170:84 , srv59178753:84 , srv63125873:84 , srv711191527:84 , srv712925184:84 , srv715751694:84 , srv762901633:84 , srv824255953:84 , srv850808935:84 , srv878659983:84 , srv938050634:84 , srv998985717:84 , srv1027172907:85 , srv1079659558:85 , srv1098044148:85 , srv1161032851:85 , srv1186158992:85 , srv1319446082:85 , srv1320041736:85 , srv1392141136:85 , srv14400937:85 , srv1450503197:85 , srv1454144295:85 , srv1456606621:85 , srv1539475972:85 , srv1562455973:85 , srv1586312364:85 , srv1607952922:85 , srv1630732639:85 , srv1674773673:85 , srv168212928:85 , srv1686573947:85 , srv1727605660:85 , srv1768192471:85 , srv1871444067:85 , srv1873932658:85 , srv1950775353:85 , srv1992625688:85 , srv201854978:85 , srv2028994761:85 , srv244632345:85 , srv249216436:85 , srv276333162:85 , srv285832957:85 , srv322052273:85 , srv353983978:85 , srv377592329:85 , srv417751336:85 , srv428604650:85 , srv447027297:85 , srv487539767:85 , srv490337843:85 , srv512980327:85 , srv542943937:85 , srv555927760:85 , srv628093790:85 , srv671476886:85 , srv707511293:85 , srv781966010:85 , srv859061225:85 , srv928165271:85 , srv1453376961:86 , srv2136449210:86 , srv762108432:86 , srv1884249884:636 }
2024-02-24 14:53:18,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2087446407=55, srv163977208=35, srv59178753=82, srv322052273=64, srv928165271=97, srv1872597659=46, srv276333162=62, srv762901633=91, srv1992625688=51, srv1319446082=10, srv850808935=94, srv260489261=61, srv1674773673=36, srv1950775353=49, srv1186158992=6, srv1320041736=11, srv225502734=57, srv244632345=58, srv1454144295=21, srv2046097457=54, srv1273202537=8, srv998985717=99, srv201854978=52, srv1562455973=28, srv377592329=66, srv1884249884=48, srv1539475972=27, srv1098044148=3, srv591425170=81, srv1161032851=4, srv1453376961=20, srv552687691=79, srv707511293=86, srv824255953=93, srv1392141136=16, srv417751336=68, srv168212928=37, srv1682709146=38, srv245683816=59, srv671476886=85, srv1450503197=19, srv1514929913=24, srv1628377461=32, srv121907193=7, srv628093790=83, srv63125873=84, srv1287717495=9, srv512980327=76, srv781966010=92, srv542943937=78, srv1456606621=22, srv1047052131=1, srv487539767=73, srv1079659558=2, srv428604650=69, srv1686573947=39, srv1526000466=26, srv1514230095=23, srv152132424=25, srv1634440006=34, srv353983978=65, srv1174460868=5, srv1768192471=41, srv249216436=60, srv859061225=95, srv2028994761=53, srv1337764081=12, srv494686716=75, srv285832957=63, srv447027297=71, srv440699545=70, srv1586312364=29, srv1388896053=14, srv1727605660=40, srv455770749=72, srv762108432=90, srv14400937=18, srv1607952922=31, srv712925184=88, srv490337843=74, srv1630732639=33, srv1792335127=42, srv379046740=67, srv555927760=80, srv1389729154=15, srv2136449210=56, srv711191527=87, srv53002932=77, srv1835412331=43, srv1873932658=47, srv1384418486=13, srv938050634=98, srv1415428439=17, srv1988221724=50, srv715751694=89, srv1871444067=45, srv1027172907=0, srv1589454527=30, srv878659983=96, srv1840160441=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:18,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:18,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:18,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:18,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:18,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:18,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:18,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:18,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-24 14:53:18,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-24 14:53:18,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-24 14:53:18,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-24 14:53:18,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-24 14:53:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-24 14:53:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-24 14:53:18,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-24 14:53:18,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-24 14:53:18,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-24 14:53:18,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-24 14:53:18,511 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:18,511 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-24 14:53:18,512 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.470651738221111E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-24 14:53:18,717 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 314 ms to try 5000 different iterations.  Found a solution that moves 17 regions; Going from a computed imbalance of 2.470651738221111E-5 to a new imbalance of 6.863105598051023E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.001888888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:18,718 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1079659558:83 , srv2136449210:83 , srv428604650:83 , srv487539767:83 , srv707511293:83 , srv762108432:83 , srv859061225:83 , srv1027172907:84 , srv1047052131:84 , srv1098044148:84 , srv1161032851:84 , srv1174460868:84 , srv1186158992:84 , srv121907193:84 , srv1273202537:84 , srv1287717495:84 , srv1319446082:84 , srv1320041736:84 , srv1337764081:84 , srv1384418486:84 , srv1388896053:84 , srv1389729154:84 , srv1392141136:84 , srv1415428439:84 , srv14400937:84 , srv1450503197:84 , srv1453376961:84 , srv1454144295:84 , srv1456606621:84 , srv1514929913:84 , srv152132424:84 , srv1539475972:84 , srv1562455973:84 , srv1586312364:84 , srv1589454527:84 , srv1607952922:84 , srv1630732639:84 , srv1634440006:84 , srv163977208:84 , srv1674773673:84 , srv168212928:84 , srv1682709146:84 , srv1686573947:84 , srv1727605660:84 , srv1768192471:84 , srv1792335127:84 , srv1835412331:84 , srv1871444067:84 , srv1872597659:84 , srv1873932658:84 , srv1950775353:84 , srv1988221724:84 , srv1992625688:84 , srv201854978:84 , srv2028994761:84 , srv2046097457:84 , srv2087446407:84 , srv225502734:84 , srv244632345:84 , srv245683816:84 , srv249216436:84 , srv260489261:84 , srv276333162:84 , srv285832957:84 , srv322052273:84 , srv353983978:84 , srv377592329:84 , srv379046740:84 , srv417751336:84 , srv440699545:84 , srv447027297:84 , srv455770749:84 , srv490337843:84 , srv512980327:84 , srv53002932:84 , srv542943937:84 , srv552687691:84 , srv555927760:84 , srv591425170:84 , srv59178753:84 , srv628093790:84 , srv63125873:84 , srv671476886:84 , srv711191527:84 , srv712925184:84 , srv715751694:84 , srv762901633:84 , srv781966010:84 , srv850808935:84 , srv928165271:84 , srv938050634:84 , srv998985717:84 , srv1514230095:85 , srv1526000466:85 , srv1628377461:85 , srv1840160441:85 , srv494686716:85 , srv824255953:85 , srv878659983:85 , srv1884249884:684 }
2024-02-24 14:53:18,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:18,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2087446407=55, srv163977208=35, srv59178753=82, srv322052273=64, srv928165271=97, srv1872597659=46, srv276333162=62, srv762901633=91, srv1992625688=51, srv1319446082=10, srv850808935=94, srv260489261=61, srv1674773673=36, srv1950775353=49, srv1186158992=6, srv1320041736=11, srv225502734=57, srv244632345=58, srv1454144295=21, srv2046097457=54, srv1273202537=8, srv998985717=99, srv201854978=52, srv1562455973=28, srv377592329=66, srv1884249884=48, srv1539475972=27, srv1098044148=3, srv591425170=81, srv1161032851=4, srv1453376961=20, srv552687691=79, srv707511293=86, srv824255953=93, srv1392141136=16, srv417751336=68, srv168212928=37, srv1682709146=38, srv245683816=59, srv671476886=85, srv1450503197=19, srv1514929913=24, srv1628377461=32, srv121907193=7, srv628093790=83, srv63125873=84, srv1287717495=9, srv512980327=76, srv781966010=92, srv542943937=78, srv1456606621=22, srv1047052131=1, srv487539767=73, srv1079659558=2, srv428604650=69, srv1686573947=39, srv1526000466=26, srv1514230095=23, srv152132424=25, srv1634440006=34, srv353983978=65, srv1174460868=5, srv1768192471=41, srv249216436=60, srv859061225=95, srv2028994761=53, srv1337764081=12, srv494686716=75, srv285832957=63, srv447027297=71, srv440699545=70, srv1586312364=29, srv1388896053=14, srv1727605660=40, srv455770749=72, srv762108432=90, srv14400937=18, srv1607952922=31, srv712925184=88, srv490337843=74, srv1630732639=33, srv1792335127=42, srv379046740=67, srv555927760=80, srv1389729154=15, srv2136449210=56, srv711191527=87, srv53002932=77, srv1835412331=43, srv1873932658=47, srv1384418486=13, srv938050634=98, srv1415428439=17, srv1988221724=50, srv715751694=89, srv1871444067=45, srv1027172907=0, srv1589454527=30, srv878659983=96, srv1840160441=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:18,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-24 14:53:18,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-24 14:53:18,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-24 14:53:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-24 14:53:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-24 14:53:18,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-24 14:53:18,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:18,841 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1079659558:83 , srv2136449210:83 , srv428604650:83 , srv487539767:83 , srv707511293:83 , srv762108432:83 , srv859061225:83 , srv1027172907:84 , srv1047052131:84 , srv1098044148:84 , srv1161032851:84 , srv1174460868:84 , srv1186158992:84 , srv121907193:84 , srv1273202537:84 , srv1287717495:84 , srv1319446082:84 , srv1320041736:84 , srv1337764081:84 , srv1384418486:84 , srv1388896053:84 , srv1389729154:84 , srv1392141136:84 , srv1415428439:84 , srv14400937:84 , srv1450503197:84 , srv1453376961:84 , srv1454144295:84 , srv1456606621:84 , srv1514929913:84 , srv152132424:84 , srv1539475972:84 , srv1562455973:84 , srv1586312364:84 , srv1589454527:84 , srv1607952922:84 , srv1630732639:84 , srv1634440006:84 , srv163977208:84 , srv1674773673:84 , srv168212928:84 , srv1682709146:84 , srv1686573947:84 , srv1727605660:84 , srv1768192471:84 , srv1792335127:84 , srv1835412331:84 , srv1871444067:84 , srv1872597659:84 , srv1873932658:84 , srv1950775353:84 , srv1988221724:84 , srv1992625688:84 , srv201854978:84 , srv2028994761:84 , srv2046097457:84 , srv2087446407:84 , srv225502734:84 , srv244632345:84 , srv245683816:84 , srv249216436:84 , srv260489261:84 , srv276333162:84 , srv285832957:84 , srv322052273:84 , srv353983978:84 , srv377592329:84 , srv379046740:84 , srv417751336:84 , srv440699545:84 , srv447027297:84 , srv455770749:84 , srv490337843:84 , srv512980327:84 , srv53002932:84 , srv542943937:84 , srv552687691:84 , srv555927760:84 , srv591425170:84 , srv59178753:84 , srv628093790:84 , srv63125873:84 , srv671476886:84 , srv711191527:84 , srv712925184:84 , srv715751694:84 , srv762901633:84 , srv781966010:84 , srv850808935:84 , srv928165271:84 , srv938050634:84 , srv998985717:84 , srv1514230095:85 , srv1526000466:85 , srv1628377461:85 , srv1840160441:85 , srv494686716:85 , srv824255953:85 , srv878659983:85 , srv1884249884:684 }
2024-02-24 14:53:18,875 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=270 (was 267) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3654 (was 4445)
2024-02-24 14:53:18,884 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=167, AvailableMemoryMB=3654
2024-02-24 14:53:18,885 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-24 14:53:18,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-24 14:53:18,896 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009413991:84 , srv1059270264:84 , srv1137444890:84 , srv1138751571:84 , srv1213846509:84 , srv1435327024:84 , srv1528917566:84 , srv1544232492:84 , srv1578903081:84 , srv1597827675:84 , srv1621608192:84 , srv1667593500:84 , srv1839679774:84 , srv2000860858:84 , srv270715136:84 , srv283520936:84 , srv305441924:84 , srv315449917:84 , srv387464121:84 , srv417523859:84 , srv453252488:84 , srv517395326:84 , srv660105440:84 , srv787260437:84 , srv818537908:84 , srv865864069:84 , srv902294733:84 , srv903194003:84 , srv932884852:84 , srv470382498:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-24 14:53:18,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:53:18,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv270715136=14, srv787260437=24, srv1138751571=3, srv1435327024=5, srv1839679774=12, srv2000860858=13, srv1528917566=6, srv417523859=19, srv818537908=25, srv470382498=21, srv1137444890=2, srv283520936=15, srv865864069=26, srv1009413991=0, srv315449917=17, srv660105440=23, srv1667593500=11, srv1544232492=7, srv903194003=28, srv1059270264=1, srv932884852=29, srv1597827675=9, srv1578903081=8, srv517395326=22, srv1213846509=4, srv453252488=20, srv1621608192=10, srv902294733=27, srv305441924=16, srv387464121=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:53:18,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:53:18,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-24 14:53:18,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.123813358836617, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:53:18,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912583175115096, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.123813358836617, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-24 14:55:18,914 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6453083 different iterations.  Found a solution that moves 1867 regions; Going from a computed imbalance of 0.9912583175115096 to a new imbalance of 4.3576711383728133E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6914814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:55:18,921 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1009413991:90 , srv1059270264:90 , srv1137444890:90 , srv1138751571:90 , srv1213846509:90 , srv1435327024:90 , srv1528917566:90 , srv1544232492:90 , srv1578903081:90 , srv1597827675:90 , srv1621608192:90 , srv1667593500:90 , srv1839679774:90 , srv2000860858:90 , srv270715136:90 , srv283520936:90 , srv305441924:90 , srv315449917:90 , srv387464121:90 , srv417523859:90 , srv453252488:90 , srv470382498:90 , srv517395326:90 , srv660105440:90 , srv787260437:90 , srv818537908:90 , srv865864069:90 , srv902294733:90 , srv903194003:90 , srv932884852:90 }
2024-02-24 14:55:18,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-24 14:55:18,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv270715136=14, srv787260437=24, srv1138751571=3, srv1435327024=5, srv1839679774=12, srv2000860858=13, srv1528917566=6, srv417523859=19, srv818537908=25, srv470382498=21, srv1137444890=2, srv283520936=15, srv865864069=26, srv1009413991=0, srv315449917=17, srv660105440=23, srv1667593500=11, srv1544232492=7, srv903194003=28, srv1059270264=1, srv932884852=29, srv1597827675=9, srv1578903081=8, srv517395326=22, srv1213846509=4, srv453252488=20, srv1621608192=10, srv902294733=27, srv305441924=16, srv387464121=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-24 14:55:18,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-24 14:55:18,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-24 14:55:18,940 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-24 14:55:18,940 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1009413991:90 , srv1059270264:90 , srv1137444890:90 , srv1138751571:90 , srv1213846509:90 , srv1435327024:90 , srv1528917566:90 , srv1544232492:90 , srv1578903081:90 , srv1597827675:90 , srv1621608192:90 , srv1667593500:90 , srv1839679774:90 , srv2000860858:90 , srv270715136:90 , srv283520936:90 , srv305441924:90 , srv315449917:90 , srv387464121:90 , srv417523859:90 , srv453252488:90 , srv470382498:90 , srv517395326:90 , srv660105440:90 , srv787260437:90 , srv818537908:90 , srv865864069:90 , srv902294733:90 , srv903194003:90 , srv932884852:90 }
2024-02-24 14:55:18,954 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 270), ProcessCount=167 (was 167), AvailableMemoryMB=3245 (was 3654)