2023-12-16 15:53:13,551 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-16 15:53:13,879 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-16 15:53:13,999 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-16 15:53:14,072 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-16 15:53:14,080 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-16 15:53:14,094 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=172, AvailableMemoryMB=5049
2023-12-16 15:53:14,096 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-16 15:53:14,096 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-16 15:53:14,218 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006400820:84 , srv1007402083:84 , srv104208113:84 , srv1046957339:84 , srv1061329290:84 , srv1120423545:84 , srv1128866606:84 , srv1132111061:84 , srv1143830113:84 , srv1177410772:84 , srv1182118932:84 , srv1204806993:84 , srv122871753:84 , srv1229470199:84 , srv1257026105:84 , srv1288554158:84 , srv1293728280:84 , srv1370341480:84 , srv1380510271:84 , srv1383978920:84 , srv1413997728:84 , srv1462503440:84 , srv1486845989:84 , srv1492487158:84 , srv1506095905:84 , srv1541967419:84 , srv1559993852:84 , srv157623647:84 , srv1583328122:84 , srv1606158214:84 , srv1653023897:84 , srv1655543454:84 , srv1661512600:84 , srv1662192951:84 , srv168930577:84 , srv1735745379:84 , srv1757342698:84 , srv1779146936:84 , srv180981074:84 , srv1830357492:84 , srv1833517309:84 , srv184740065:84 , srv1906890854:84 , srv1907338929:84 , srv1908053315:84 , srv1920429809:84 , srv1951685573:84 , srv195600895:84 , srv1957906758:84 , srv2018653389:84 , srv2070548269:84 , srv2072381079:84 , srv2085963379:84 , srv2106646718:84 , srv212061880:84 , srv2145475704:84 , srv231795059:84 , srv240056122:84 , srv272973215:84 , srv290979342:84 , srv324199419:84 , srv346465832:84 , srv37431320:84 , srv375721720:84 , srv392974556:84 , srv401284920:84 , srv403748547:84 , srv446986733:84 , srv447638698:84 , srv461981826:84 , srv468079444:84 , srv477033410:84 , srv491018635:84 , srv512435398:84 , srv554251069:84 , srv560800416:84 , srv577584244:84 , srv593734922:84 , srv596040774:84 , srv59993510:84 , srv602057499:84 , srv603624010:84 , srv624366644:84 , srv625037455:84 , srv631566464:84 , srv646870929:84 , srv665494674:84 , srv726109747:84 , srv751684222:84 , srv774362519:84 , srv792278367:84 , srv807462339:84 , srv855542133:84 , srv879860104:84 , srv882865406:84 , srv885993391:84 , srv918910761:84 , srv952078713:84 , srv981531415:84 , srv1161367443:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-16 15:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv554251069=75, srv212061880=55, srv401284920=66, srv272973215=59, srv885993391=96, srv1061329290=4, srv1006400820=0, srv1661512600=33, srv918910761=97, srv1559993852=27, srv807462339=92, srv122871753=13, srv2072381079=52, srv882865406=95, srv403748547=67, srv1906890854=43, srv324199419=61, srv1462503440=22, srv1370341480=18, srv1288554158=16, srv603624010=82, srv1293728280=17, srv1182118932=11, srv1007402083=1, srv726109747=88, srv2085963379=53, srv631566464=85, srv1662192951=34, srv195600895=48, srv1655543454=32, srv184740065=42, srv646870929=86, srv1908053315=45, srv1833517309=41, srv1128866606=6, srv1204806993=12, srv375721720=64, srv1492487158=24, srv1830357492=40, srv2070548269=51, srv1920429809=46, srv1046957339=3, srv1143830113=8, srv1583328122=29, srv1132111061=7, srv593734922=78, srv2145475704=56, srv577584244=77, srv461981826=70, srv168930577=35, srv625037455=84, srv1951685573=47, srv751684222=89, srv1413997728=21, srv468079444=71, srv665494674=87, srv104208113=2, srv447638698=69, srv1779146936=38, srv180981074=39, srv1506095905=25, srv596040774=79, srv855542133=93, srv1653023897=31, srv774362519=90, srv1229470199=14, srv1383978920=20, srv1177410772=10, srv1120423545=5, srv157623647=28, srv290979342=60, srv231795059=57, srv446986733=68, srv1541967419=26, srv952078713=98, srv1907338929=44, srv624366644=83, srv37431320=63, srv477033410=72, srv2018653389=50, srv1486845989=23, srv1257026105=15, srv491018635=73, srv2106646718=54, srv346465832=62, srv59993510=80, srv1161367443=9, srv512435398=74, srv981531415=99, srv1735745379=36, srv240056122=58, srv560800416=76, srv1606158214=30, srv602057499=81, srv392974556=65, srv1380510271=19, srv1757342698=37, srv1957906758=49, srv792278367=91, srv879860104=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:53:14,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:53:14,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:53:14,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:53:14,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:53:14,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:53:14,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:53:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:53:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:53:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:53:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:53:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:53:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:53:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:53:14,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 15:53:14,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 15:53:14,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 15:53:14,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 15:53:14,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 15:53:14,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 15:53:14,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 15:53:14,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 15:53:14,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:14,588 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 15:53:14,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 15:53:14,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 562 ms to try 5000 different iterations.  Found a solution that moves 4736 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17196645539965766. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03928434494903247, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056967905982307075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5262222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03928434494903247, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.167, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23483333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:14,943 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv446986733:81 , srv1177410772:82 , srv1830357492:82 , srv272973215:82 , srv1061329290:83 , srv1143830113:83 , srv1288554158:83 , srv807462339:83 , srv981531415:83 , srv1204806993:84 , srv1257026105:84 , srv1293728280:84 , srv1606158214:84 , srv1662192951:84 , srv1833517309:84 , srv212061880:84 , srv290979342:84 , srv468079444:84 , srv512435398:84 , srv593734922:84 , srv751684222:84 , srv885993391:84 , srv1132111061:85 , srv1182118932:85 , srv122871753:85 , srv1383978920:85 , srv1462503440:85 , srv1541967419:85 , srv1653023897:85 , srv1655543454:85 , srv180981074:85 , srv195600895:85 , srv2072381079:85 , srv2085963379:85 , srv2106646718:85 , srv2145475704:85 , srv477033410:85 , srv560800416:85 , srv624366644:85 , srv631566464:85 , srv646870929:85 , srv665494674:85 , srv1006400820:86 , srv1046957339:86 , srv1370341480:86 , srv1492487158:86 , srv1583328122:86 , srv1920429809:86 , srv1951685573:86 , srv447638698:86 , srv491018635:86 , srv59993510:86 , srv792278367:86 , srv104208113:87 , srv1229470199:87 , srv1380510271:87 , srv157623647:87 , srv1906890854:87 , srv1907338929:87 , srv1957906758:87 , srv2070548269:87 , srv37431320:87 , srv392974556:87 , srv554251069:87 , srv577584244:87 , srv596040774:87 , srv602057499:87 , srv625037455:87 , srv855542133:87 , srv882865406:87 , srv952078713:87 , srv1007402083:88 , srv1120423545:88 , srv1559993852:88 , srv1661512600:88 , srv168930577:88 , srv1735745379:88 , srv1779146936:88 , srv401284920:88 , srv403748547:88 , srv461981826:88 , srv603624010:88 , srv879860104:88 , srv346465832:89 , srv375721720:89 , srv726109747:89 , srv1486845989:90 , srv1908053315:90 , srv2018653389:90 , srv231795059:90 , srv774362519:90 , srv1413997728:91 , srv184740065:91 , srv1506095905:92 , srv240056122:92 , srv1128866606:93 , srv918910761:93 , srv1757342698:95 , srv324199419:95 , srv1161367443:439 }
2023-12-16 15:53:14,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:53:14,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv554251069=75, srv212061880=55, srv401284920=66, srv272973215=59, srv885993391=96, srv1061329290=4, srv1006400820=0, srv1661512600=33, srv918910761=97, srv1559993852=27, srv807462339=92, srv122871753=13, srv2072381079=52, srv882865406=95, srv403748547=67, srv1906890854=43, srv324199419=61, srv1462503440=22, srv1370341480=18, srv1288554158=16, srv603624010=82, srv1293728280=17, srv1182118932=11, srv1007402083=1, srv726109747=88, srv2085963379=53, srv631566464=85, srv1662192951=34, srv195600895=48, srv1655543454=32, srv184740065=42, srv646870929=86, srv1908053315=45, srv1833517309=41, srv1128866606=6, srv1204806993=12, srv375721720=64, srv1492487158=24, srv1830357492=40, srv2070548269=51, srv1920429809=46, srv1046957339=3, srv1143830113=8, srv1583328122=29, srv1132111061=7, srv593734922=78, srv2145475704=56, srv577584244=77, srv461981826=70, srv168930577=35, srv625037455=84, srv1951685573=47, srv751684222=89, srv1413997728=21, srv468079444=71, srv665494674=87, srv104208113=2, srv447638698=69, srv1779146936=38, srv180981074=39, srv1506095905=25, srv596040774=79, srv855542133=93, srv1653023897=31, srv774362519=90, srv1229470199=14, srv1383978920=20, srv1177410772=10, srv1120423545=5, srv157623647=28, srv290979342=60, srv231795059=57, srv446986733=68, srv1541967419=26, srv952078713=98, srv1907338929=44, srv624366644=83, srv37431320=63, srv477033410=72, srv2018653389=50, srv1486845989=23, srv1257026105=15, srv491018635=73, srv2106646718=54, srv346465832=62, srv59993510=80, srv1161367443=9, srv512435398=74, srv981531415=99, srv1735745379=36, srv240056122=58, srv560800416=76, srv1606158214=30, srv602057499=81, srv392974556=65, srv1380510271=19, srv1757342698=37, srv1957906758=49, srv792278367=91, srv879860104=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:53:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:53:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:53:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:53:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:53:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:53:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 15:53:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 15:53:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 15:53:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 15:53:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 15:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 15:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 15:53:15,102 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03928434494903247, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056967905982307075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03928434494903247, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.167, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23483333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:15,102 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 15:53:15,103 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17193329321886816, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03928434494903247, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056967905982307075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03928434494903247, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.167, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23483333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 15:53:15,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 2573 regions; Going from a computed imbalance of 0.17193329321886816 to a new imbalance of 0.014004797358268175. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020590485079762633); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03518748884891766, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2858888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020590485079762633); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:15,400 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1757342698:77 , srv324199419:78 , srv1128866606:79 , srv1413997728:80 , srv1506095905:80 , srv1908053315:80 , srv1486845989:81 , srv918910761:81 , srv1661512600:82 , srv184740065:82 , srv240056122:82 , srv774362519:82 , srv879860104:82 , srv1559993852:83 , srv157623647:83 , srv2018653389:83 , srv375721720:83 , srv1006400820:84 , srv1007402083:84 , srv1120423545:84 , srv1370341480:84 , srv168930577:84 , srv1906890854:84 , srv2070548269:84 , srv231795059:84 , srv346465832:84 , srv37431320:84 , srv401284920:84 , srv882865406:84 , srv104208113:85 , srv1204806993:85 , srv122871753:85 , srv1380510271:85 , srv1920429809:85 , srv1951685573:85 , srv2072381079:85 , srv403748547:85 , srv461981826:85 , srv477033410:85 , srv554251069:85 , srv602057499:85 , srv603624010:85 , srv625037455:85 , srv726109747:85 , srv792278367:85 , srv855542133:85 , srv952078713:85 , srv1046957339:86 , srv1735745379:86 , srv1779146936:86 , srv180981074:86 , srv195600895:86 , srv1957906758:86 , srv2145475704:86 , srv392974556:86 , srv491018635:86 , srv512435398:86 , srv577584244:86 , srv596040774:86 , srv1132111061:87 , srv1229470199:87 , srv1462503440:87 , srv1492487158:87 , srv1541967419:87 , srv1833517309:87 , srv2085963379:87 , srv212061880:87 , srv631566464:87 , srv751684222:87 , srv885993391:87 , srv981531415:87 , srv1061329290:88 , srv1383978920:88 , srv1653023897:88 , srv1907338929:88 , srv290979342:88 , srv447638698:88 , srv560800416:88 , srv593734922:88 , srv59993510:88 , srv646870929:88 , srv665494674:88 , srv1143830113:89 , srv1182118932:89 , srv1257026105:89 , srv1293728280:89 , srv1583328122:89 , srv1606158214:89 , srv1655543454:89 , srv1830357492:89 , srv2106646718:89 , srv624366644:89 , srv807462339:89 , srv1177410772:90 , srv1288554158:90 , srv1662192951:90 , srv468079444:90 , srv272973215:91 , srv446986733:92 , srv1161367443:518 }
2023-12-16 15:53:15,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:53:15,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv554251069=75, srv212061880=55, srv401284920=66, srv272973215=59, srv885993391=96, srv1061329290=4, srv1006400820=0, srv1661512600=33, srv918910761=97, srv1559993852=27, srv807462339=92, srv122871753=13, srv2072381079=52, srv882865406=95, srv403748547=67, srv1906890854=43, srv324199419=61, srv1462503440=22, srv1370341480=18, srv1288554158=16, srv603624010=82, srv1293728280=17, srv1182118932=11, srv1007402083=1, srv726109747=88, srv2085963379=53, srv631566464=85, srv1662192951=34, srv195600895=48, srv1655543454=32, srv184740065=42, srv646870929=86, srv1908053315=45, srv1833517309=41, srv1128866606=6, srv1204806993=12, srv375721720=64, srv1492487158=24, srv1830357492=40, srv2070548269=51, srv1920429809=46, srv1046957339=3, srv1143830113=8, srv1583328122=29, srv1132111061=7, srv593734922=78, srv2145475704=56, srv577584244=77, srv461981826=70, srv168930577=35, srv625037455=84, srv1951685573=47, srv751684222=89, srv1413997728=21, srv468079444=71, srv665494674=87, srv104208113=2, srv447638698=69, srv1779146936=38, srv180981074=39, srv1506095905=25, srv596040774=79, srv855542133=93, srv1653023897=31, srv774362519=90, srv1229470199=14, srv1383978920=20, srv1177410772=10, srv1120423545=5, srv157623647=28, srv290979342=60, srv231795059=57, srv446986733=68, srv1541967419=26, srv952078713=98, srv1907338929=44, srv624366644=83, srv37431320=63, srv477033410=72, srv2018653389=50, srv1486845989=23, srv1257026105=15, srv491018635=73, srv2106646718=54, srv346465832=62, srv59993510=80, srv1161367443=9, srv512435398=74, srv981531415=99, srv1735745379=36, srv240056122=58, srv560800416=76, srv1606158214=30, srv602057499=81, srv392974556=65, srv1380510271=19, srv1757342698=37, srv1957906758=49, srv792278367=91, srv879860104=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 15:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 15:53:15,566 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020590485079762633); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03518748884891766, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020590485079762633); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:15,566 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 15:53:15,567 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013986780827193136, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020590485079762633); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03518748884891766, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020590485079762633); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 15:53:15,798 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 350 ms to try 5000 different iterations.  Found a solution that moves 925 regions; Going from a computed imbalance of 0.013986780827193136 to a new imbalance of 9.456153679122427E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006655433858912234); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008178699991918044); MoveCostFunction : (multiplier=7.0, imbalance=0.10277777777777777, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006655433858912234); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:15,800 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1583328122:82 , srv240056122:82 , srv1182118932:83 , srv1229470199:83 , srv1735745379:83 , srv1907338929:83 , srv2106646718:83 , srv231795059:83 , srv346465832:83 , srv918910761:83 , srv1293728280:84 , srv1383978920:84 , srv1492487158:84 , srv1606158214:84 , srv1655543454:84 , srv1662192951:84 , srv1779146936:84 , srv1957906758:84 , srv272973215:84 , srv324199419:84 , srv447638698:84 , srv461981826:84 , srv468079444:84 , srv560800416:84 , srv577584244:84 , srv59993510:84 , srv624366644:84 , srv646870929:84 , srv665494674:84 , srv726109747:84 , srv855542133:84 , srv1007402083:85 , srv104208113:85 , srv1120423545:85 , srv1257026105:85 , srv1288554158:85 , srv1380510271:85 , srv1462503440:85 , srv1506095905:85 , srv1653023897:85 , srv168930577:85 , srv1757342698:85 , srv184740065:85 , srv2018653389:85 , srv2070548269:85 , srv2085963379:85 , srv392974556:85 , srv401284920:85 , srv403748547:85 , srv446986733:85 , srv593734922:85 , srv596040774:85 , srv602057499:85 , srv603624010:85 , srv631566464:85 , srv774362519:85 , srv952078713:85 , srv1046957339:86 , srv1128866606:86 , srv1132111061:86 , srv1143830113:86 , srv1177410772:86 , srv1370341480:86 , srv1541967419:86 , srv1559993852:86 , srv1830357492:86 , srv1833517309:86 , srv1906890854:86 , srv1920429809:86 , srv2145475704:86 , srv290979342:86 , srv37431320:86 , srv375721720:86 , srv491018635:86 , srv554251069:86 , srv625037455:86 , srv751684222:86 , srv807462339:86 , srv882865406:86 , srv885993391:86 , srv1006400820:87 , srv1061329290:87 , srv122871753:87 , srv1413997728:87 , srv1486845989:87 , srv1661512600:87 , srv180981074:87 , srv1908053315:87 , srv1951685573:87 , srv195600895:87 , srv212061880:87 , srv792278367:87 , srv981531415:87 , srv1204806993:88 , srv157623647:88 , srv2072381079:88 , srv477033410:88 , srv879860104:88 , srv512435398:89 , srv1161367443:560 }
2023-12-16 15:53:15,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:53:15,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv554251069=75, srv212061880=55, srv401284920=66, srv272973215=59, srv885993391=96, srv1061329290=4, srv1006400820=0, srv1661512600=33, srv918910761=97, srv1559993852=27, srv807462339=92, srv122871753=13, srv2072381079=52, srv882865406=95, srv403748547=67, srv1906890854=43, srv324199419=61, srv1462503440=22, srv1370341480=18, srv1288554158=16, srv603624010=82, srv1293728280=17, srv1182118932=11, srv1007402083=1, srv726109747=88, srv2085963379=53, srv631566464=85, srv1662192951=34, srv195600895=48, srv1655543454=32, srv184740065=42, srv646870929=86, srv1908053315=45, srv1833517309=41, srv1128866606=6, srv1204806993=12, srv375721720=64, srv1492487158=24, srv1830357492=40, srv2070548269=51, srv1920429809=46, srv1046957339=3, srv1143830113=8, srv1583328122=29, srv1132111061=7, srv593734922=78, srv2145475704=56, srv577584244=77, srv461981826=70, srv168930577=35, srv625037455=84, srv1951685573=47, srv751684222=89, srv1413997728=21, srv468079444=71, srv665494674=87, srv104208113=2, srv447638698=69, srv1779146936=38, srv180981074=39, srv1506095905=25, srv596040774=79, srv855542133=93, srv1653023897=31, srv774362519=90, srv1229470199=14, srv1383978920=20, srv1177410772=10, srv1120423545=5, srv157623647=28, srv290979342=60, srv231795059=57, srv446986733=68, srv1541967419=26, srv952078713=98, srv1907338929=44, srv624366644=83, srv37431320=63, srv477033410=72, srv2018653389=50, srv1486845989=23, srv1257026105=15, srv491018635=73, srv2106646718=54, srv346465832=62, srv59993510=80, srv1161367443=9, srv512435398=74, srv981531415=99, srv1735745379=36, srv240056122=58, srv560800416=76, srv1606158214=30, srv602057499=81, srv392974556=65, srv1380510271=19, srv1757342698=37, srv1957906758=49, srv792278367=91, srv879860104=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 15:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 15:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 15:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 15:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 15:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 15:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 15:53:15,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 15:53:15,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006655433858912234); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008178699991918044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006655433858912234); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:15,932 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 15:53:15,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.391383794767929E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006655433858912234); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008178699991918044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006655433858912234); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 15:53:16,260 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 427 ms to try 5000 different iterations.  Found a solution that moves 257 regions; Going from a computed imbalance of 9.391383794767929E-4 to a new imbalance of 1.9294034954422364E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.028555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:16,261 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1413997728:83 , srv512435398:83 , srv1046957339:84 , srv1061329290:84 , srv1128866606:84 , srv1132111061:84 , srv1143830113:84 , srv1177410772:84 , srv122871753:84 , srv1257026105:84 , srv1288554158:84 , srv1293728280:84 , srv1486845989:84 , srv1506095905:84 , srv1541967419:84 , srv157623647:84 , srv1653023897:84 , srv1655543454:84 , srv1662192951:84 , srv1779146936:84 , srv180981074:84 , srv1833517309:84 , srv1951685573:84 , srv195600895:84 , srv2018653389:84 , srv2072381079:84 , srv212061880:84 , srv375721720:84 , srv392974556:84 , srv403748547:84 , srv446986733:84 , srv447638698:84 , srv468079444:84 , srv477033410:84 , srv491018635:84 , srv596040774:84 , srv59993510:84 , srv603624010:84 , srv624366644:84 , srv625037455:84 , srv726109747:84 , srv751684222:84 , srv807462339:84 , srv879860104:84 , srv1006400820:85 , srv1007402083:85 , srv104208113:85 , srv1120423545:85 , srv1182118932:85 , srv1204806993:85 , srv1229470199:85 , srv1380510271:85 , srv1383978920:85 , srv1462503440:85 , srv1492487158:85 , srv1559993852:85 , srv1583328122:85 , srv1606158214:85 , srv1661512600:85 , srv1735745379:85 , srv1757342698:85 , srv1830357492:85 , srv184740065:85 , srv1906890854:85 , srv1907338929:85 , srv1908053315:85 , srv1920429809:85 , srv1957906758:85 , srv2070548269:85 , srv2085963379:85 , srv2106646718:85 , srv2145475704:85 , srv231795059:85 , srv272973215:85 , srv290979342:85 , srv324199419:85 , srv401284920:85 , srv461981826:85 , srv554251069:85 , srv560800416:85 , srv577584244:85 , srv593734922:85 , srv602057499:85 , srv631566464:85 , srv646870929:85 , srv665494674:85 , srv774362519:85 , srv792278367:85 , srv882865406:85 , srv885993391:85 , srv918910761:85 , srv952078713:85 , srv981531415:85 , srv1370341480:86 , srv168930577:86 , srv240056122:86 , srv346465832:86 , srv37431320:86 , srv855542133:86 , srv1161367443:625 }
2023-12-16 15:53:16,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:53:16,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv554251069=75, srv212061880=55, srv401284920=66, srv272973215=59, srv885993391=96, srv1061329290=4, srv1006400820=0, srv1661512600=33, srv918910761=97, srv1559993852=27, srv807462339=92, srv122871753=13, srv2072381079=52, srv882865406=95, srv403748547=67, srv1906890854=43, srv324199419=61, srv1462503440=22, srv1370341480=18, srv1288554158=16, srv603624010=82, srv1293728280=17, srv1182118932=11, srv1007402083=1, srv726109747=88, srv2085963379=53, srv631566464=85, srv1662192951=34, srv195600895=48, srv1655543454=32, srv184740065=42, srv646870929=86, srv1908053315=45, srv1833517309=41, srv1128866606=6, srv1204806993=12, srv375721720=64, srv1492487158=24, srv1830357492=40, srv2070548269=51, srv1920429809=46, srv1046957339=3, srv1143830113=8, srv1583328122=29, srv1132111061=7, srv593734922=78, srv2145475704=56, srv577584244=77, srv461981826=70, srv168930577=35, srv625037455=84, srv1951685573=47, srv751684222=89, srv1413997728=21, srv468079444=71, srv665494674=87, srv104208113=2, srv447638698=69, srv1779146936=38, srv180981074=39, srv1506095905=25, srv596040774=79, srv855542133=93, srv1653023897=31, srv774362519=90, srv1229470199=14, srv1383978920=20, srv1177410772=10, srv1120423545=5, srv157623647=28, srv290979342=60, srv231795059=57, srv446986733=68, srv1541967419=26, srv952078713=98, srv1907338929=44, srv624366644=83, srv37431320=63, srv477033410=72, srv2018653389=50, srv1486845989=23, srv1257026105=15, srv491018635=73, srv2106646718=54, srv346465832=62, srv59993510=80, srv1161367443=9, srv512435398=74, srv981531415=99, srv1735745379=36, srv240056122=58, srv560800416=76, srv1606158214=30, srv602057499=81, srv392974556=65, srv1380510271=19, srv1757342698=37, srv1957906758=49, srv792278367=91, srv879860104=94} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 15:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 15:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 15:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 15:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 15:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 15:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 15:53:16,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 15:53:16,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 15:53:16,392 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7494482491816342E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:16,392 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1413997728:83 , srv512435398:83 , srv1046957339:84 , srv1061329290:84 , srv1128866606:84 , srv1132111061:84 , srv1143830113:84 , srv1177410772:84 , srv122871753:84 , srv1257026105:84 , srv1288554158:84 , srv1293728280:84 , srv1486845989:84 , srv1506095905:84 , srv1541967419:84 , srv157623647:84 , srv1653023897:84 , srv1655543454:84 , srv1662192951:84 , srv1779146936:84 , srv180981074:84 , srv1833517309:84 , srv1951685573:84 , srv195600895:84 , srv2018653389:84 , srv2072381079:84 , srv212061880:84 , srv375721720:84 , srv392974556:84 , srv403748547:84 , srv446986733:84 , srv447638698:84 , srv468079444:84 , srv477033410:84 , srv491018635:84 , srv596040774:84 , srv59993510:84 , srv603624010:84 , srv624366644:84 , srv625037455:84 , srv726109747:84 , srv751684222:84 , srv807462339:84 , srv879860104:84 , srv1006400820:85 , srv1007402083:85 , srv104208113:85 , srv1120423545:85 , srv1182118932:85 , srv1204806993:85 , srv1229470199:85 , srv1380510271:85 , srv1383978920:85 , srv1462503440:85 , srv1492487158:85 , srv1559993852:85 , srv1583328122:85 , srv1606158214:85 , srv1661512600:85 , srv1735745379:85 , srv1757342698:85 , srv1830357492:85 , srv184740065:85 , srv1906890854:85 , srv1907338929:85 , srv1908053315:85 , srv1920429809:85 , srv1957906758:85 , srv2070548269:85 , srv2085963379:85 , srv2106646718:85 , srv2145475704:85 , srv231795059:85 , srv272973215:85 , srv290979342:85 , srv324199419:85 , srv401284920:85 , srv461981826:85 , srv554251069:85 , srv560800416:85 , srv577584244:85 , srv593734922:85 , srv602057499:85 , srv631566464:85 , srv646870929:85 , srv665494674:85 , srv774362519:85 , srv792278367:85 , srv882865406:85 , srv885993391:85 , srv918910761:85 , srv952078713:85 , srv981531415:85 , srv1370341480:86 , srv168930577:86 , srv240056122:86 , srv346465832:86 , srv37431320:86 , srv855542133:86 , srv1161367443:625 }
2023-12-16 15:53:16,419 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 317), ProcessCount=172 (was 172), AvailableMemoryMB=4456 (was 5049)
2023-12-16 15:53:16,427 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=172, AvailableMemoryMB=4456
2023-12-16 15:53:16,428 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-16 15:53:16,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-16 15:53:16,437 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1174989517:84 , srv1340009050:84 , srv1420455993:84 , srv1422752500:84 , srv1427316910:84 , srv1506051990:84 , srv1508593099:84 , srv1510263135:84 , srv1689742402:84 , srv1798662076:84 , srv1814489693:84 , srv1817320982:84 , srv1826689280:84 , srv1901030739:84 , srv1978548406:84 , srv1986261392:84 , srv225243570:84 , srv228407120:84 , srv247319132:84 , srv259053986:84 , srv266812549:84 , srv354675959:84 , srv379450368:84 , srv455503522:84 , srv629066583:84 , srv672855919:84 , srv78288672:84 , srv831398989:84 , srv986357959:84 , srv1579435280:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-16 15:53:16,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:53:16,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv259053986=20, srv629066583=25, srv1798662076=10, srv1427316910=4, srv379450368=23, srv78288672=27, srv1689742402=9, srv354675959=22, srv1814489693=11, srv831398989=28, srv986357959=29, srv225243570=17, srv1901030739=14, srv247319132=19, srv1508593099=6, srv266812549=21, srv672855919=26, srv228407120=18, srv1422752500=3, srv455503522=24, srv1340009050=1, srv1506051990=5, srv1420455993=2, srv1817320982=12, srv1579435280=8, srv1978548406=15, srv1174989517=0, srv1826689280=13, srv1510263135=7, srv1986261392=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:53:16,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:53:16,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:53:16,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-16 15:53:16,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.158361617318017, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:53:16,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912692035549465, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.158361617318017, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-16 15:55:16,450 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6155850 different iterations.  Found a solution that moves 1864 regions; Going from a computed imbalance of 0.9912692035549465 to a new imbalance of 4.3506689887128686E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6903703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:55:16,457 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1174989517:90 , srv1340009050:90 , srv1420455993:90 , srv1422752500:90 , srv1427316910:90 , srv1506051990:90 , srv1508593099:90 , srv1510263135:90 , srv1579435280:90 , srv1689742402:90 , srv1798662076:90 , srv1814489693:90 , srv1817320982:90 , srv1826689280:90 , srv1901030739:90 , srv1978548406:90 , srv1986261392:90 , srv225243570:90 , srv228407120:90 , srv247319132:90 , srv259053986:90 , srv266812549:90 , srv354675959:90 , srv379450368:90 , srv455503522:90 , srv629066583:90 , srv672855919:90 , srv78288672:90 , srv831398989:90 , srv986357959:90 }
2023-12-16 15:55:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 15:55:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv259053986=20, srv629066583=25, srv1798662076=10, srv1427316910=4, srv379450368=23, srv78288672=27, srv1689742402=9, srv354675959=22, srv1814489693=11, srv831398989=28, srv986357959=29, srv225243570=17, srv1901030739=14, srv247319132=19, srv1508593099=6, srv266812549=21, srv672855919=26, srv228407120=18, srv1422752500=3, srv455503522=24, srv1340009050=1, srv1506051990=5, srv1420455993=2, srv1817320982=12, srv1579435280=8, srv1978548406=15, srv1174989517=0, srv1826689280=13, srv1510263135=7, srv1986261392=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 15:55:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 15:55:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 15:55:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 15:55:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 15:55:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 15:55:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 15:55:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-16 15:55:16,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 15:55:16,483 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1174989517:90 , srv1340009050:90 , srv1420455993:90 , srv1422752500:90 , srv1427316910:90 , srv1506051990:90 , srv1508593099:90 , srv1510263135:90 , srv1579435280:90 , srv1689742402:90 , srv1798662076:90 , srv1814489693:90 , srv1817320982:90 , srv1826689280:90 , srv1901030739:90 , srv1978548406:90 , srv1986261392:90 , srv225243570:90 , srv228407120:90 , srv247319132:90 , srv259053986:90 , srv266812549:90 , srv354675959:90 , srv379450368:90 , srv455503522:90 , srv629066583:90 , srv672855919:90 , srv78288672:90 , srv831398989:90 , srv986357959:90 }
2023-12-16 15:55:16,500 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 317), ProcessCount=168 (was 172), AvailableMemoryMB=3536 (was 4456)