2024-02-09 10:54:08,661 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-09 10:54:08,910 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-09 10:54:09,009 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-09 10:54:09,063 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-09 10:54:09,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-09 10:54:09,081 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=177, AvailableMemoryMB=17011
2024-02-09 10:54:09,083 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-09 10:54:09,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-09 10:54:09,198 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1060439861:84 , srv1121128404:84 , srv1165398029:84 , srv1182098850:84 , srv1203338864:84 , srv1207358623:84 , srv1207737286:84 , srv125683944:84 , srv1258115662:84 , srv1331869353:84 , srv1351272311:84 , srv1354299621:84 , srv1375929038:84 , srv1400842692:84 , srv1401064653:84 , srv1455308613:84 , srv1461795237:84 , srv1473969902:84 , srv1484478708:84 , srv1505359688:84 , srv1525844517:84 , srv1552763821:84 , srv1565234736:84 , srv1613044415:84 , srv1614928512:84 , srv1629574783:84 , srv1634740355:84 , srv166703989:84 , srv1675090517:84 , srv167599017:84 , srv1690045738:84 , srv1691492905:84 , srv1724726621:84 , srv1740127791:84 , srv1743689125:84 , srv1748574895:84 , srv175341172:84 , srv1754775440:84 , srv176366874:84 , srv1804848350:84 , srv1818809213:84 , srv1843062099:84 , srv1856239638:84 , srv1861145985:84 , srv1918719115:84 , srv191887670:84 , srv1995293183:84 , srv1996950853:84 , srv2027998208:84 , srv2028622632:84 , srv2059350505:84 , srv2066785897:84 , srv2067233703:84 , srv2070966497:84 , srv2072425745:84 , srv2081854736:84 , srv253718722:84 , srv264432913:84 , srv27334114:84 , srv287461672:84 , srv29368799:84 , srv306778536:84 , srv312784123:84 , srv318366873:84 , srv332341839:84 , srv335707043:84 , srv349831901:84 , srv363153694:84 , srv370315091:84 , srv386260461:84 , srv423197188:84 , srv434586078:84 , srv460721820:84 , srv471897408:84 , srv473665348:84 , srv479905106:84 , srv509970330:84 , srv510274066:84 , srv514829458:84 , srv532994650:84 , srv559228021:84 , srv563104032:84 , srv573592237:84 , srv597558198:84 , srv599124220:84 , srv610983649:84 , srv613701596:84 , srv636171136:84 , srv678454965:84 , srv702471490:84 , srv71740044:84 , srv720359888:84 , srv817144622:84 , srv86381690:84 , srv874206449:84 , srv876104909:84 , srv893359173:84 , srv934908670:84 , srv944752779:84 , srv1616644423:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-09 10:54:09,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv167599017=30, srv1525844517=20, srv332341839=65, srv532994650=80, srv514829458=79, srv1691492905=32, srv1455308613=15, srv1613044415=23, srv1995293183=47, srv349831901=67, srv29368799=61, srv1818809213=41, srv71740044=91, srv1473969902=17, srv176366874=39, srv1182098850=3, srv2027998208=49, srv2067233703=53, srv613701596=87, srv1675090517=29, srv702471490=90, srv166703989=28, srv2081854736=56, srv678454965=89, srv335707043=66, srv2066785897=52, srv1375929038=12, srv817144622=93, srv423197188=71, srv1060439861=0, srv2059350505=51, srv471897408=74, srv1565234736=22, srv306778536=62, srv2072425745=55, srv1207737286=6, srv1505359688=19, srv86381690=94, srv434586078=72, srv610983649=86, srv312784123=63, srv27334114=59, srv1614928512=24, srv1629574783=26, srv876104909=96, srv1634740355=27, srv1754775440=38, srv1843062099=42, srv287461672=60, srv2028622632=50, srv944752779=99, srv473665348=75, srv559228021=81, srv1165398029=2, srv1461795237=16, srv1400842692=13, srv597558198=84, srv1856239638=43, srv1861145985=44, srv253718722=57, srv874206449=95, srv460721820=73, srv893359173=97, srv1918719115=45, srv1484478708=18, srv599124220=85, srv1354299621=11, srv510274066=78, srv191887670=46, srv509970330=77, srv1743689125=35, srv1690045738=31, srv479905106=76, srv318366873=64, srv264432913=58, srv386260461=70, srv1207358623=5, srv1258115662=8, srv175341172=37, srv1331869353=9, srv125683944=7, srv573592237=83, srv1996950853=48, srv1401064653=14, srv1804848350=40, srv1616644423=25, srv363153694=68, srv1552763821=21, srv1351272311=10, srv1203338864=4, srv1748574895=36, srv1724726621=33, srv934908670=98, srv563104032=82, srv1740127791=34, srv2070966497=54, srv1121128404=1, srv370315091=69, srv720359888=92, srv636171136=88} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:09,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:09,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:09,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:09,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:09,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:09,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:09,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 10:54:09,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 10:54:09,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 10:54:09,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 10:54:09,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 10:54:09,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 10:54:09,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 10:54:09,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 10:54:09,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:09,524 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 10:54:09,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 10:54:09,781 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 480 ms to try 5000 different iterations.  Found a solution that moves 4680 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17548817866751162. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039726901610370326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05394639231261509, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.52, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039726901610370326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17091666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23491666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:09,790 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1613044415:82 , srv191887670:82 , srv287461672:82 , srv363153694:82 , srv573592237:82 , srv1375929038:83 , srv1565234736:83 , srv166703989:83 , srv1843062099:83 , srv2028622632:83 , srv473665348:83 , srv1455308613:84 , srv1525844517:84 , srv2066785897:84 , srv27334114:84 , srv306778536:84 , srv312784123:84 , srv335707043:84 , srv471897408:84 , srv613701596:84 , srv86381690:84 , srv874206449:84 , srv876104909:84 , srv1203338864:85 , srv1354299621:85 , srv1484478708:85 , srv1691492905:85 , srv1724726621:85 , srv1743689125:85 , srv1748574895:85 , srv176366874:85 , srv1856239638:85 , srv2070966497:85 , srv532994650:85 , srv559228021:85 , srv636171136:85 , srv934908670:85 , srv1060439861:86 , srv1182098850:86 , srv1258115662:86 , srv1634740355:86 , srv1690045738:86 , srv1754775440:86 , srv1818809213:86 , srv1861145985:86 , srv1918719115:86 , srv2072425745:86 , srv29368799:86 , srv318366873:86 , srv460721820:86 , srv514829458:86 , srv597558198:86 , srv817144622:86 , srv1331869353:87 , srv1400842692:87 , srv1461795237:87 , srv1505359688:87 , srv1614928512:87 , srv1629574783:87 , srv1804848350:87 , srv2027998208:87 , srv2059350505:87 , srv332341839:87 , srv479905106:87 , srv509970330:87 , srv599124220:87 , srv610983649:87 , srv678454965:87 , srv71740044:87 , srv893359173:87 , srv944752779:87 , srv1165398029:88 , srv1207358623:88 , srv1207737286:88 , srv1351272311:88 , srv1675090517:88 , srv1995293183:88 , srv1996950853:88 , srv510274066:88 , srv563104032:88 , srv720359888:88 , srv125683944:89 , srv1401064653:89 , srv1473969902:89 , srv1740127791:89 , srv349831901:89 , srv423197188:89 , srv434586078:89 , srv702471490:89 , srv175341172:90 , srv2081854736:90 , srv264432913:90 , srv370315091:90 , srv1121128404:91 , srv1552763821:91 , srv2067233703:91 , srv167599017:92 , srv253718722:94 , srv386260461:98 , srv1616644423:443 }
2024-02-09 10:54:09,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:09,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv167599017=30, srv1525844517=20, srv332341839=65, srv532994650=80, srv514829458=79, srv1691492905=32, srv1455308613=15, srv1613044415=23, srv1995293183=47, srv349831901=67, srv29368799=61, srv1818809213=41, srv71740044=91, srv1473969902=17, srv176366874=39, srv1182098850=3, srv2027998208=49, srv2067233703=53, srv613701596=87, srv1675090517=29, srv702471490=90, srv166703989=28, srv2081854736=56, srv678454965=89, srv335707043=66, srv2066785897=52, srv1375929038=12, srv817144622=93, srv423197188=71, srv1060439861=0, srv2059350505=51, srv471897408=74, srv1565234736=22, srv306778536=62, srv2072425745=55, srv1207737286=6, srv1505359688=19, srv86381690=94, srv434586078=72, srv610983649=86, srv312784123=63, srv27334114=59, srv1614928512=24, srv1629574783=26, srv876104909=96, srv1634740355=27, srv1754775440=38, srv1843062099=42, srv287461672=60, srv2028622632=50, srv944752779=99, srv473665348=75, srv559228021=81, srv1165398029=2, srv1461795237=16, srv1400842692=13, srv597558198=84, srv1856239638=43, srv1861145985=44, srv253718722=57, srv874206449=95, srv460721820=73, srv893359173=97, srv1918719115=45, srv1484478708=18, srv599124220=85, srv1354299621=11, srv510274066=78, srv191887670=46, srv509970330=77, srv1743689125=35, srv1690045738=31, srv479905106=76, srv318366873=64, srv264432913=58, srv386260461=70, srv1207358623=5, srv1258115662=8, srv175341172=37, srv1331869353=9, srv125683944=7, srv573592237=83, srv1996950853=48, srv1401064653=14, srv1804848350=40, srv1616644423=25, srv363153694=68, srv1552763821=21, srv1351272311=10, srv1203338864=4, srv1748574895=36, srv1724726621=33, srv934908670=98, srv563104032=82, srv1740127791=34, srv2070966497=54, srv1121128404=1, srv370315091=69, srv720359888=92, srv636171136=88} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:09,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:09,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:09,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:09,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 10:54:09,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 10:54:09,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 10:54:09,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 10:54:09,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 10:54:09,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 10:54:09,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 10:54:09,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 10:54:09,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 10:54:09,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039726901610370326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05394639231261509, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039726901610370326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17091666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23491666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:09,941 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 10:54:09,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1754554086071031, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039726901610370326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05394639231261509, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039726901610370326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17091666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23491666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 10:54:10,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 287 ms to try 5000 different iterations.  Found a solution that moves 2618 regions; Going from a computed imbalance of 0.1754554086071031 to a new imbalance of 0.014504978844665437. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02361040138895038); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034670162993851096, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29088888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02361040138895038); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,125 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv386260461:73 , srv1121128404:80 , srv1552763821:80 , srv167599017:80 , srv253718722:80 , srv1473969902:81 , srv175341172:81 , srv2067233703:81 , srv1207358623:82 , srv125683944:82 , srv1331869353:82 , srv264432913:82 , srv349831901:82 , srv702471490:82 , srv1505359688:83 , srv1614928512:83 , srv1740127791:83 , srv2081854736:83 , srv423197188:83 , srv509970330:83 , srv1165398029:84 , srv1351272311:84 , srv1400842692:84 , srv1401064653:84 , srv1675090517:84 , srv1995293183:84 , srv434586078:84 , srv514829458:84 , srv893359173:84 , srv944752779:84 , srv1060439861:85 , srv1182098850:85 , srv1207737286:85 , srv1461795237:85 , srv1629574783:85 , srv1743689125:85 , srv1818809213:85 , srv1996950853:85 , srv2072425745:85 , srv318366873:85 , srv332341839:85 , srv479905106:85 , srv563104032:85 , srv597558198:85 , srv610983649:85 , srv720359888:85 , srv1354299621:86 , srv1634740355:86 , srv1690045738:86 , srv1691492905:86 , srv1754775440:86 , srv176366874:86 , srv1804848350:86 , srv1856239638:86 , srv1861145985:86 , srv1918719115:86 , srv2027998208:86 , srv2066785897:86 , srv2070966497:86 , srv370315091:86 , srv510274066:86 , srv613701596:86 , srv678454965:86 , srv71740044:86 , srv1258115662:87 , srv1455308613:87 , srv1484478708:87 , srv1613044415:87 , srv1724726621:87 , srv2059350505:87 , srv29368799:87 , srv460721820:87 , srv471897408:87 , srv599124220:87 , srv817144622:87 , srv876104909:87 , srv934908670:87 , srv1203338864:88 , srv1375929038:88 , srv166703989:88 , srv1748574895:88 , srv27334114:88 , srv306778536:88 , srv312784123:88 , srv532994650:88 , srv559228021:88 , srv573592237:88 , srv874206449:88 , srv1525844517:89 , srv1843062099:89 , srv191887670:89 , srv287461672:89 , srv335707043:89 , srv636171136:89 , srv86381690:89 , srv1565234736:90 , srv363153694:90 , srv2028622632:91 , srv473665348:92 , srv1616644423:541 }
2024-02-09 10:54:10,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:10,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv167599017=30, srv1525844517=20, srv332341839=65, srv532994650=80, srv514829458=79, srv1691492905=32, srv1455308613=15, srv1613044415=23, srv1995293183=47, srv349831901=67, srv29368799=61, srv1818809213=41, srv71740044=91, srv1473969902=17, srv176366874=39, srv1182098850=3, srv2027998208=49, srv2067233703=53, srv613701596=87, srv1675090517=29, srv702471490=90, srv166703989=28, srv2081854736=56, srv678454965=89, srv335707043=66, srv2066785897=52, srv1375929038=12, srv817144622=93, srv423197188=71, srv1060439861=0, srv2059350505=51, srv471897408=74, srv1565234736=22, srv306778536=62, srv2072425745=55, srv1207737286=6, srv1505359688=19, srv86381690=94, srv434586078=72, srv610983649=86, srv312784123=63, srv27334114=59, srv1614928512=24, srv1629574783=26, srv876104909=96, srv1634740355=27, srv1754775440=38, srv1843062099=42, srv287461672=60, srv2028622632=50, srv944752779=99, srv473665348=75, srv559228021=81, srv1165398029=2, srv1461795237=16, srv1400842692=13, srv597558198=84, srv1856239638=43, srv1861145985=44, srv253718722=57, srv874206449=95, srv460721820=73, srv893359173=97, srv1918719115=45, srv1484478708=18, srv599124220=85, srv1354299621=11, srv510274066=78, srv191887670=46, srv509970330=77, srv1743689125=35, srv1690045738=31, srv479905106=76, srv318366873=64, srv264432913=58, srv386260461=70, srv1207358623=5, srv1258115662=8, srv175341172=37, srv1331869353=9, srv125683944=7, srv573592237=83, srv1996950853=48, srv1401064653=14, srv1804848350=40, srv1616644423=25, srv363153694=68, srv1552763821=21, srv1351272311=10, srv1203338864=4, srv1748574895=36, srv1724726621=33, srv934908670=98, srv563104032=82, srv1740127791=34, srv2070966497=54, srv1121128404=1, srv370315091=69, srv720359888=92, srv636171136=88} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:10,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:10,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:10,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 10:54:10,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 10:54:10,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 10:54:10,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 10:54:10,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 10:54:10,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 10:54:10,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02361040138895038); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034670162993851096, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02361040138895038); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,229 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 10:54:10,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0144866472168557, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02361040138895038); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034670162993851096, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02361040138895038); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 10:54:10,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 224 ms to try 5000 different iterations.  Found a solution that moves 974 regions; Going from a computed imbalance of 0.0144866472168557 to a new imbalance of 6.038869006539313E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007221574692546627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008247027829070787); MoveCostFunction : (multiplier=7.0, imbalance=0.10822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007221574692546627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,385 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv370315091:80 , srv473665348:82 , srv2028622632:83 , srv510274066:83 , srv599124220:83 , srv1207737286:84 , srv1401064653:84 , srv1525844517:84 , srv1565234736:84 , srv1748574895:84 , srv1861145985:84 , srv1918719115:84 , srv1996950853:84 , srv2027998208:84 , srv2059350505:84 , srv253718722:84 , srv29368799:84 , srv335707043:84 , srv363153694:84 , srv532994650:84 , srv559228021:84 , srv563104032:84 , srv636171136:84 , srv678454965:84 , srv720359888:84 , srv1121128404:85 , srv1203338864:85 , srv1258115662:85 , srv1484478708:85 , srv1634740355:85 , srv1675090517:85 , srv167599017:85 , srv1690045738:85 , srv1724726621:85 , srv1740127791:85 , srv1804848350:85 , srv1995293183:85 , srv2081854736:85 , srv264432913:85 , srv27334114:85 , srv287461672:85 , srv306778536:85 , srv312784123:85 , srv460721820:85 , srv71740044:85 , srv817144622:85 , srv86381690:85 , srv874206449:85 , srv934908670:85 , srv1060439861:86 , srv1182098850:86 , srv125683944:86 , srv1351272311:86 , srv1354299621:86 , srv1375929038:86 , srv1455308613:86 , srv1461795237:86 , srv1629574783:86 , srv166703989:86 , srv1754775440:86 , srv1843062099:86 , srv2066785897:86 , srv2067233703:86 , srv2070966497:86 , srv332341839:86 , srv423197188:86 , srv434586078:86 , srv471897408:86 , srv479905106:86 , srv597558198:86 , srv702471490:86 , srv893359173:86 , srv1165398029:87 , srv1207358623:87 , srv1400842692:87 , srv1473969902:87 , srv1505359688:87 , srv1552763821:87 , srv1614928512:87 , srv1691492905:87 , srv1743689125:87 , srv176366874:87 , srv1818809213:87 , srv1856239638:87 , srv191887670:87 , srv2072425745:87 , srv318366873:87 , srv349831901:87 , srv386260461:87 , srv509970330:87 , srv514829458:87 , srv573592237:87 , srv610983649:87 , srv613701596:87 , srv876104909:87 , srv944752779:87 , srv1613044415:88 , srv175341172:88 , srv1331869353:89 , srv1616644423:538 }
2024-02-09 10:54:10,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:10,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv167599017=30, srv1525844517=20, srv332341839=65, srv532994650=80, srv514829458=79, srv1691492905=32, srv1455308613=15, srv1613044415=23, srv1995293183=47, srv349831901=67, srv29368799=61, srv1818809213=41, srv71740044=91, srv1473969902=17, srv176366874=39, srv1182098850=3, srv2027998208=49, srv2067233703=53, srv613701596=87, srv1675090517=29, srv702471490=90, srv166703989=28, srv2081854736=56, srv678454965=89, srv335707043=66, srv2066785897=52, srv1375929038=12, srv817144622=93, srv423197188=71, srv1060439861=0, srv2059350505=51, srv471897408=74, srv1565234736=22, srv306778536=62, srv2072425745=55, srv1207737286=6, srv1505359688=19, srv86381690=94, srv434586078=72, srv610983649=86, srv312784123=63, srv27334114=59, srv1614928512=24, srv1629574783=26, srv876104909=96, srv1634740355=27, srv1754775440=38, srv1843062099=42, srv287461672=60, srv2028622632=50, srv944752779=99, srv473665348=75, srv559228021=81, srv1165398029=2, srv1461795237=16, srv1400842692=13, srv597558198=84, srv1856239638=43, srv1861145985=44, srv253718722=57, srv874206449=95, srv460721820=73, srv893359173=97, srv1918719115=45, srv1484478708=18, srv599124220=85, srv1354299621=11, srv510274066=78, srv191887670=46, srv509970330=77, srv1743689125=35, srv1690045738=31, srv479905106=76, srv318366873=64, srv264432913=58, srv386260461=70, srv1207358623=5, srv1258115662=8, srv175341172=37, srv1331869353=9, srv125683944=7, srv573592237=83, srv1996950853=48, srv1401064653=14, srv1804848350=40, srv1616644423=25, srv363153694=68, srv1552763821=21, srv1351272311=10, srv1203338864=4, srv1748574895=36, srv1724726621=33, srv934908670=98, srv563104032=82, srv1740127791=34, srv2070966497=54, srv1121128404=1, srv370315091=69, srv720359888=92, srv636171136=88} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:10,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:10,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 10:54:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 10:54:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 10:54:10,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 10:54:10,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 10:54:10,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 10:54:10,480 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007221574692546627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008247027829070787); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007221574692546627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,480 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 10:54:10,481 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.970668068851442E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007221574692546627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008247027829070787); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007221574692546627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 10:54:10,697 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 286 ms to try 5000 different iterations.  Found a solution that moves 294 regions; Going from a computed imbalance of 5.970668068851442E-4 to a new imbalance of 4.388734697298166E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.03266666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,697 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv434586078:82 , srv1165398029:83 , srv175341172:83 , srv2072425745:83 , srv610983649:83 , srv1203338864:84 , srv1207358623:84 , srv1258115662:84 , srv1331869353:84 , srv1351272311:84 , srv1400842692:84 , srv1473969902:84 , srv1552763821:84 , srv1629574783:84 , srv1675090517:84 , srv1690045738:84 , srv1691492905:84 , srv1740127791:84 , srv1754775440:84 , srv176366874:84 , srv1804848350:84 , srv1818809213:84 , srv1843062099:84 , srv191887670:84 , srv2059350505:84 , srv2081854736:84 , srv253718722:84 , srv27334114:84 , srv318366873:84 , srv332341839:84 , srv349831901:84 , srv386260461:84 , srv423197188:84 , srv460721820:84 , srv479905106:84 , srv510274066:84 , srv636171136:84 , srv71740044:84 , srv817144622:84 , srv86381690:84 , srv876104909:84 , srv944752779:84 , srv1060439861:85 , srv1182098850:85 , srv1207737286:85 , srv125683944:85 , srv1354299621:85 , srv1375929038:85 , srv1401064653:85 , srv1455308613:85 , srv1461795237:85 , srv1484478708:85 , srv1505359688:85 , srv1525844517:85 , srv1565234736:85 , srv1613044415:85 , srv1614928512:85 , srv1634740355:85 , srv166703989:85 , srv167599017:85 , srv1743689125:85 , srv1748574895:85 , srv1856239638:85 , srv1996950853:85 , srv2027998208:85 , srv2028622632:85 , srv2067233703:85 , srv2070966497:85 , srv264432913:85 , srv29368799:85 , srv312784123:85 , srv335707043:85 , srv471897408:85 , srv473665348:85 , srv509970330:85 , srv514829458:85 , srv532994650:85 , srv563104032:85 , srv573592237:85 , srv597558198:85 , srv599124220:85 , srv613701596:85 , srv678454965:85 , srv702471490:85 , srv720359888:85 , srv874206449:85 , srv934908670:85 , srv1121128404:86 , srv1724726621:86 , srv1861145985:86 , srv1918719115:86 , srv1995293183:86 , srv2066785897:86 , srv287461672:86 , srv306778536:86 , srv363153694:86 , srv370315091:86 , srv559228021:86 , srv893359173:86 , srv1616644423:621 }
2024-02-09 10:54:10,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:10,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv167599017=30, srv1525844517=20, srv332341839=65, srv532994650=80, srv514829458=79, srv1691492905=32, srv1455308613=15, srv1613044415=23, srv1995293183=47, srv349831901=67, srv29368799=61, srv1818809213=41, srv71740044=91, srv1473969902=17, srv176366874=39, srv1182098850=3, srv2027998208=49, srv2067233703=53, srv613701596=87, srv1675090517=29, srv702471490=90, srv166703989=28, srv2081854736=56, srv678454965=89, srv335707043=66, srv2066785897=52, srv1375929038=12, srv817144622=93, srv423197188=71, srv1060439861=0, srv2059350505=51, srv471897408=74, srv1565234736=22, srv306778536=62, srv2072425745=55, srv1207737286=6, srv1505359688=19, srv86381690=94, srv434586078=72, srv610983649=86, srv312784123=63, srv27334114=59, srv1614928512=24, srv1629574783=26, srv876104909=96, srv1634740355=27, srv1754775440=38, srv1843062099=42, srv287461672=60, srv2028622632=50, srv944752779=99, srv473665348=75, srv559228021=81, srv1165398029=2, srv1461795237=16, srv1400842692=13, srv597558198=84, srv1856239638=43, srv1861145985=44, srv253718722=57, srv874206449=95, srv460721820=73, srv893359173=97, srv1918719115=45, srv1484478708=18, srv599124220=85, srv1354299621=11, srv510274066=78, srv191887670=46, srv509970330=77, srv1743689125=35, srv1690045738=31, srv479905106=76, srv318366873=64, srv264432913=58, srv386260461=70, srv1207358623=5, srv1258115662=8, srv175341172=37, srv1331869353=9, srv125683944=7, srv573592237=83, srv1996950853=48, srv1401064653=14, srv1804848350=40, srv1616644423=25, srv363153694=68, srv1552763821=21, srv1351272311=10, srv1203338864=4, srv1748574895=36, srv1724726621=33, srv934908670=98, srv563104032=82, srv1740127791=34, srv2070966497=54, srv1121128404=1, srv370315091=69, srv720359888=92, srv636171136=88} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:10,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:10,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 10:54:10,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 10:54:10,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 10:54:10,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 10:54:10,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 10:54:10,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 10:54:10,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,793 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 10:54:10,793 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.1828714972957656E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 10:54:10,950 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 228 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 4.1828714972957656E-5 to a new imbalance of 8.175750307519066E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:10,951 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1461795237:83 , srv1724726621:83 , srv1856239638:83 , srv1995293183:83 , srv2067233703:83 , srv306778536:83 , srv559228021:83 , srv893359173:83 , srv1060439861:84 , srv1121128404:84 , srv1165398029:84 , srv1182098850:84 , srv1203338864:84 , srv1207737286:84 , srv125683944:84 , srv1258115662:84 , srv1331869353:84 , srv1351272311:84 , srv1354299621:84 , srv1375929038:84 , srv1400842692:84 , srv1401064653:84 , srv1455308613:84 , srv1484478708:84 , srv1505359688:84 , srv1525844517:84 , srv1552763821:84 , srv1565234736:84 , srv1613044415:84 , srv1614928512:84 , srv1629574783:84 , srv1634740355:84 , srv166703989:84 , srv167599017:84 , srv1691492905:84 , srv1743689125:84 , srv1748574895:84 , srv175341172:84 , srv1754775440:84 , srv176366874:84 , srv1804848350:84 , srv1818809213:84 , srv1843062099:84 , srv1861145985:84 , srv1918719115:84 , srv191887670:84 , srv1996950853:84 , srv2027998208:84 , srv2028622632:84 , srv2059350505:84 , srv2066785897:84 , srv2070966497:84 , srv2081854736:84 , srv253718722:84 , srv264432913:84 , srv287461672:84 , srv29368799:84 , srv312784123:84 , srv318366873:84 , srv332341839:84 , srv335707043:84 , srv349831901:84 , srv363153694:84 , srv370315091:84 , srv386260461:84 , srv423197188:84 , srv460721820:84 , srv471897408:84 , srv473665348:84 , srv479905106:84 , srv509970330:84 , srv514829458:84 , srv532994650:84 , srv563104032:84 , srv573592237:84 , srv597558198:84 , srv599124220:84 , srv610983649:84 , srv613701596:84 , srv636171136:84 , srv678454965:84 , srv702471490:84 , srv71740044:84 , srv720359888:84 , srv817144622:84 , srv86381690:84 , srv874206449:84 , srv876104909:84 , srv934908670:84 , srv944752779:84 , srv1207358623:85 , srv1473969902:85 , srv1675090517:85 , srv1690045738:85 , srv1740127791:85 , srv2072425745:85 , srv27334114:85 , srv434586078:85 , srv510274066:85 , srv1616644423:683 }
2024-02-09 10:54:10,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:10,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv167599017=30, srv1525844517=20, srv332341839=65, srv532994650=80, srv514829458=79, srv1691492905=32, srv1455308613=15, srv1613044415=23, srv1995293183=47, srv349831901=67, srv29368799=61, srv1818809213=41, srv71740044=91, srv1473969902=17, srv176366874=39, srv1182098850=3, srv2027998208=49, srv2067233703=53, srv613701596=87, srv1675090517=29, srv702471490=90, srv166703989=28, srv2081854736=56, srv678454965=89, srv335707043=66, srv2066785897=52, srv1375929038=12, srv817144622=93, srv423197188=71, srv1060439861=0, srv2059350505=51, srv471897408=74, srv1565234736=22, srv306778536=62, srv2072425745=55, srv1207737286=6, srv1505359688=19, srv86381690=94, srv434586078=72, srv610983649=86, srv312784123=63, srv27334114=59, srv1614928512=24, srv1629574783=26, srv876104909=96, srv1634740355=27, srv1754775440=38, srv1843062099=42, srv287461672=60, srv2028622632=50, srv944752779=99, srv473665348=75, srv559228021=81, srv1165398029=2, srv1461795237=16, srv1400842692=13, srv597558198=84, srv1856239638=43, srv1861145985=44, srv253718722=57, srv874206449=95, srv460721820=73, srv893359173=97, srv1918719115=45, srv1484478708=18, srv599124220=85, srv1354299621=11, srv510274066=78, srv191887670=46, srv509970330=77, srv1743689125=35, srv1690045738=31, srv479905106=76, srv318366873=64, srv264432913=58, srv386260461=70, srv1207358623=5, srv1258115662=8, srv175341172=37, srv1331869353=9, srv125683944=7, srv573592237=83, srv1996950853=48, srv1401064653=14, srv1804848350=40, srv1616644423=25, srv363153694=68, srv1552763821=21, srv1351272311=10, srv1203338864=4, srv1748574895=36, srv1724726621=33, srv934908670=98, srv563104032=82, srv1740127791=34, srv2070966497=54, srv1121128404=1, srv370315091=69, srv720359888=92, srv636171136=88} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:10,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:10,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 10:54:10,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 10:54:10,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 10:54:10,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 10:54:10,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 10:54:10,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 10:54:10,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 10:54:10,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 10:54:10,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 10:54:10,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 10:54:11,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:11,046 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1461795237:83 , srv1724726621:83 , srv1856239638:83 , srv1995293183:83 , srv2067233703:83 , srv306778536:83 , srv559228021:83 , srv893359173:83 , srv1060439861:84 , srv1121128404:84 , srv1165398029:84 , srv1182098850:84 , srv1203338864:84 , srv1207737286:84 , srv125683944:84 , srv1258115662:84 , srv1331869353:84 , srv1351272311:84 , srv1354299621:84 , srv1375929038:84 , srv1400842692:84 , srv1401064653:84 , srv1455308613:84 , srv1484478708:84 , srv1505359688:84 , srv1525844517:84 , srv1552763821:84 , srv1565234736:84 , srv1613044415:84 , srv1614928512:84 , srv1629574783:84 , srv1634740355:84 , srv166703989:84 , srv167599017:84 , srv1691492905:84 , srv1743689125:84 , srv1748574895:84 , srv175341172:84 , srv1754775440:84 , srv176366874:84 , srv1804848350:84 , srv1818809213:84 , srv1843062099:84 , srv1861145985:84 , srv1918719115:84 , srv191887670:84 , srv1996950853:84 , srv2027998208:84 , srv2028622632:84 , srv2059350505:84 , srv2066785897:84 , srv2070966497:84 , srv2081854736:84 , srv253718722:84 , srv264432913:84 , srv287461672:84 , srv29368799:84 , srv312784123:84 , srv318366873:84 , srv332341839:84 , srv335707043:84 , srv349831901:84 , srv363153694:84 , srv370315091:84 , srv386260461:84 , srv423197188:84 , srv460721820:84 , srv471897408:84 , srv473665348:84 , srv479905106:84 , srv509970330:84 , srv514829458:84 , srv532994650:84 , srv563104032:84 , srv573592237:84 , srv597558198:84 , srv599124220:84 , srv610983649:84 , srv613701596:84 , srv636171136:84 , srv678454965:84 , srv702471490:84 , srv71740044:84 , srv720359888:84 , srv817144622:84 , srv86381690:84 , srv874206449:84 , srv876104909:84 , srv934908670:84 , srv944752779:84 , srv1207358623:85 , srv1473969902:85 , srv1675090517:85 , srv1690045738:85 , srv1740127791:85 , srv2072425745:85 , srv27334114:85 , srv434586078:85 , srv510274066:85 , srv1616644423:683 }
2024-02-09 10:54:11,067 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 200), ProcessCount=178 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=16533 (was 17011)
2024-02-09 10:54:11,074 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=178, AvailableMemoryMB=16533
2024-02-09 10:54:11,075 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-09 10:54:11,075 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-09 10:54:11,084 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010101927:84 , srv1063558841:84 , srv1087641576:84 , srv1096305685:84 , srv1170083192:84 , srv1175062757:84 , srv140885145:84 , srv1501642679:84 , srv1652959941:84 , srv1693617601:84 , srv1721619894:84 , srv1874680001:84 , srv1913569857:84 , srv1924210516:84 , srv1936293918:84 , srv2099501760:84 , srv234893678:84 , srv246496897:84 , srv272339341:84 , srv5033123:84 , srv563518393:84 , srv567039631:84 , srv625206422:84 , srv63075389:84 , srv631551817:84 , srv710567890:84 , srv928841523:84 , srv963507652:84 , srv994500473:84 , srv19439285:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-09 10:54:11,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:54:11,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087641576=2, srv1693617601=9, srv1170083192=4, srv234893678=17, srv272339341=19, srv563518393=21, srv19439285=15, srv1913569857=12, srv1652959941=8, srv1924210516=13, srv140885145=6, srv1096305685=3, srv928841523=27, srv1874680001=11, srv246496897=18, srv1010101927=0, srv710567890=26, srv631551817=25, srv1063558841=1, srv1175062757=5, srv567039631=22, srv1936293918=14, srv2099501760=16, srv1721619894=10, srv994500473=29, srv5033123=20, srv63075389=24, srv625206422=23, srv963507652=28, srv1501642679=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:54:11,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:54:11,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-09 10:54:11,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0819198460733317, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:54:11,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912451170024329, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0819198460733317, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-09 10:56:11,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9776042 different iterations.  Found a solution that moves 1835 regions; Going from a computed imbalance of 0.9912451170024329 to a new imbalance of 4.2829815420000605E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6796296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:56:11,105 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010101927:90 , srv1063558841:90 , srv1087641576:90 , srv1096305685:90 , srv1170083192:90 , srv1175062757:90 , srv140885145:90 , srv1501642679:90 , srv1652959941:90 , srv1693617601:90 , srv1721619894:90 , srv1874680001:90 , srv1913569857:90 , srv1924210516:90 , srv1936293918:90 , srv19439285:90 , srv2099501760:90 , srv234893678:90 , srv246496897:90 , srv272339341:90 , srv5033123:90 , srv563518393:90 , srv567039631:90 , srv625206422:90 , srv63075389:90 , srv631551817:90 , srv710567890:90 , srv928841523:90 , srv963507652:90 , srv994500473:90 }
2024-02-09 10:56:11,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 10:56:11,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087641576=2, srv1693617601=9, srv1170083192=4, srv234893678=17, srv272339341=19, srv563518393=21, srv19439285=15, srv1913569857=12, srv1652959941=8, srv1924210516=13, srv140885145=6, srv1096305685=3, srv928841523=27, srv1874680001=11, srv246496897=18, srv1010101927=0, srv710567890=26, srv631551817=25, srv1063558841=1, srv1175062757=5, srv567039631=22, srv1936293918=14, srv2099501760=16, srv1721619894=10, srv994500473=29, srv5033123=20, srv63075389=24, srv625206422=23, srv963507652=28, srv1501642679=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 10:56:11,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 10:56:11,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 10:56:11,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 10:56:11,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 10:56:11,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 10:56:11,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-09 10:56:11,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 10:56:11,120 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1010101927:90 , srv1063558841:90 , srv1087641576:90 , srv1096305685:90 , srv1170083192:90 , srv1175062757:90 , srv140885145:90 , srv1501642679:90 , srv1652959941:90 , srv1693617601:90 , srv1721619894:90 , srv1874680001:90 , srv1913569857:90 , srv1924210516:90 , srv1936293918:90 , srv19439285:90 , srv2099501760:90 , srv234893678:90 , srv246496897:90 , srv272339341:90 , srv5033123:90 , srv563518393:90 , srv567039631:90 , srv625206422:90 , srv63075389:90 , srv631551817:90 , srv710567890:90 , srv928841523:90 , srv963507652:90 , srv994500473:90 }
2024-02-09 10:56:11,134 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 200), ProcessCount=175 (was 178), AvailableMemoryMB=16481 (was 16533)