2023-10-15 04:53:30,531 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-15 04:53:30,853 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-15 04:53:30,966 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-15 04:53:31,033 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-15 04:53:31,041 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-15 04:53:31,055 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=338, ProcessCount=173, AvailableMemoryMB=6873
2023-10-15 04:53:31,057 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-15 04:53:31,057 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-15 04:53:31,200 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005932285:84 , srv1031674438:84 , srv1037677359:84 , srv10377812:84 , srv1052131090:84 , srv1061625540:84 , srv1063359006:84 , srv1067642603:84 , srv1077489403:84 , srv1083799801:84 , srv1105543244:84 , srv1135765057:84 , srv1156462510:84 , srv1159495338:84 , srv1160786536:84 , srv1211982643:84 , srv1236274586:84 , srv1240926202:84 , srv1246654233:84 , srv1246876366:84 , srv1304014356:84 , srv1313152104:84 , srv1322859542:84 , srv1352400711:84 , srv1356082129:84 , srv136333362:84 , srv1378901658:84 , srv1412095293:84 , srv1418666654:84 , srv1449322838:84 , srv1476564162:84 , srv1490637560:84 , srv1499131325:84 , srv1546830352:84 , srv156862370:84 , srv1574002366:84 , srv1595678116:84 , srv1628174482:84 , srv1648588239:84 , srv1650430525:84 , srv1651709557:84 , srv1658567345:84 , srv1663276973:84 , srv1741931695:84 , srv1748666232:84 , srv1752344111:84 , srv1759797352:84 , srv1774098179:84 , srv1838567578:84 , srv192849611:84 , srv1944923628:84 , srv1950505748:84 , srv1992892206:84 , srv1993145381:84 , srv2029834638:84 , srv2050610978:84 , srv2053382347:84 , srv2070307311:84 , srv2074940884:84 , srv2085202659:84 , srv2091903272:84 , srv2110791263:84 , srv2133123090:84 , srv2137816620:84 , srv2147159293:84 , srv22743104:84 , srv231280946:84 , srv25901391:84 , srv283308642:84 , srv315830269:84 , srv340893365:84 , srv367321917:84 , srv376322145:84 , srv386567965:84 , srv443081849:84 , srv452091242:84 , srv475673017:84 , srv504178869:84 , srv556139096:84 , srv567118414:84 , srv572529245:84 , srv602911677:84 , srv605319538:84 , srv622813646:84 , srv640347099:84 , srv649386917:84 , srv64939472:84 , srv658691858:84 , srv675516185:84 , srv746327886:84 , srv751009606:84 , srv752999968:84 , srv771162264:84 , srv842089724:84 , srv852245250:84 , srv868723063:84 , srv920712072:84 , srv92217577:84 , srv960352924:84 , srv1684793654:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-15 04:53:31,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:31,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1352400711=23, srv1105543244=10, srv1067642603=7, srv1313152104=21, srv1077489403=8, srv751009606=91, srv2029834638=55, srv1449322838=29, srv675516185=89, srv1651709557=40, srv1741931695=44, srv1322859542=22, srv1944923628=51, srv1031674438=1, srv1083799801=9, srv1490637560=31, srv1412095293=27, srv1628174482=37, srv1595678116=36, srv1759797352=47, srv842089724=94, srv443081849=75, srv1838567578=49, srv1378901658=26, srv475673017=77, srv136333362=25, srv1663276973=42, srv771162264=93, srv2085202659=60, srv602911677=82, srv567118414=80, srv192849611=50, srv315830269=70, srv1574002366=35, srv2091903272=61, srv1356082129=24, srv1658567345=41, srv1418666654=28, srv1160786536=14, srv376322145=73, srv283308642=69, srv852245250=95, srv504178869=78, srv92217577=98, srv1648588239=38, srv2147159293=65, srv1061625540=5, srv572529245=81, srv658691858=88, srv1684793654=43, srv10377812=3, srv1052131090=4, srv868723063=96, srv1005932285=0, srv1037677359=2, srv2133123090=63, srv386567965=74, srv1211982643=15, srv1246654233=18, srv156862370=34, srv752999968=92, srv2070307311=58, srv367321917=72, srv1063359006=6, srv1499131325=32, srv2053382347=57, srv231280946=67, srv746327886=90, srv622813646=84, srv1748666232=45, srv556139096=79, srv22743104=66, srv1752344111=46, srv2137816620=64, srv1236274586=16, srv920712072=97, srv649386917=86, srv1156462510=12, srv1476564162=30, srv2074940884=59, srv1246876366=19, srv1950505748=52, srv1159495338=13, srv640347099=85, srv1546830352=33, srv605319538=83, srv960352924=99, srv1135765057=11, srv64939472=87, srv25901391=68, srv340893365=71, srv1992892206=53, srv1774098179=48, srv1993145381=54, srv2050610978=56, srv1650430525=39, srv2110791263=62, srv1304014356=20, srv452091242=76, srv1240926202=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:31,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:31,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:31,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:31,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:31,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:31,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:31,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:31,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:31,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:31,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:31,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:31,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:31,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:31,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:31,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:31,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:31,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:31,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:31,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:31,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:31,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:31,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:31,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:31,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:31,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:31,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:31,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:31,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:31,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:31,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:31,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 04:53:31,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 04:53:31,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 04:53:31,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 04:53:31,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 04:53:31,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 04:53:31,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 04:53:31,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 04:53:31,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 04:53:31,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 04:53:31,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 04:53:31,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 04:53:31,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 04:53:31,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 04:53:31,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 04:53:31,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 04:53:31,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 04:53:31,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 04:53:31,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 04:53:31,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 04:53:31,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 04:53:31,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 04:53:31,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 04:53:31,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 04:53:31,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 04:53:31,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 04:53:31,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 04:53:31,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 04:53:31,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 04:53:31,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:31,733 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 04:53:31,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 04:53:32,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 776 ms to try 5000 different iterations.  Found a solution that moves 4679 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1812119255084941. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04109609335312651, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05570283508170091, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5198888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04109609335312651, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:32,179 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1651709557:80 , srv1741931695:80 , srv1838567578:80 , srv1950505748:80 , srv2050610978:80 , srv1313152104:81 , srv367321917:81 , srv1077489403:82 , srv658691858:82 , srv1037677359:83 , srv1083799801:83 , srv1304014356:83 , srv1748666232:83 , srv868723063:83 , srv1159495338:84 , srv1240926202:84 , srv1246654233:84 , srv1418666654:84 , srv156862370:84 , srv1595678116:84 , srv1663276973:84 , srv1759797352:84 , srv1774098179:84 , srv1944923628:84 , srv504178869:84 , srv605319538:84 , srv64939472:84 , srv771162264:84 , srv1005932285:85 , srv1160786536:85 , srv1236274586:85 , srv1476564162:85 , srv1499131325:85 , srv1648588239:85 , srv1993145381:85 , srv572529245:85 , srv1031674438:86 , srv10377812:86 , srv1135765057:86 , srv1211982643:86 , srv1490637560:86 , srv1546830352:86 , srv1992892206:86 , srv2070307311:86 , srv2091903272:86 , srv475673017:86 , srv622813646:86 , srv640347099:86 , srv751009606:86 , srv852245250:86 , srv1052131090:87 , srv1156462510:87 , srv1322859542:87 , srv1352400711:87 , srv1574002366:87 , srv1650430525:87 , srv1752344111:87 , srv2085202659:87 , srv2137816620:87 , srv2147159293:87 , srv22743104:87 , srv25901391:87 , srv340893365:87 , srv567118414:87 , srv675516185:87 , srv752999968:87 , srv842089724:87 , srv1061625540:88 , srv1067642603:88 , srv1105543244:88 , srv1246876366:88 , srv1658567345:88 , srv2029834638:88 , srv2053382347:88 , srv2074940884:88 , srv2110791263:88 , srv2133123090:88 , srv746327886:88 , srv1063359006:89 , srv136333362:89 , srv1378901658:89 , srv1628174482:89 , srv283308642:89 , srv649386917:89 , srv92217577:89 , srv1356082129:90 , srv192849611:90 , srv231280946:90 , srv376322145:90 , srv386567965:90 , srv443081849:90 , srv452091242:90 , srv960352924:90 , srv1412095293:91 , srv556139096:91 , srv315830269:92 , srv602911677:93 , srv920712072:93 , srv1449322838:94 , srv1684793654:455 }
2023-10-15 04:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1352400711=23, srv1105543244=10, srv1067642603=7, srv1313152104=21, srv1077489403=8, srv751009606=91, srv2029834638=55, srv1449322838=29, srv675516185=89, srv1651709557=40, srv1741931695=44, srv1322859542=22, srv1944923628=51, srv1031674438=1, srv1083799801=9, srv1490637560=31, srv1412095293=27, srv1628174482=37, srv1595678116=36, srv1759797352=47, srv842089724=94, srv443081849=75, srv1838567578=49, srv1378901658=26, srv475673017=77, srv136333362=25, srv1663276973=42, srv771162264=93, srv2085202659=60, srv602911677=82, srv567118414=80, srv192849611=50, srv315830269=70, srv1574002366=35, srv2091903272=61, srv1356082129=24, srv1658567345=41, srv1418666654=28, srv1160786536=14, srv376322145=73, srv283308642=69, srv852245250=95, srv504178869=78, srv92217577=98, srv1648588239=38, srv2147159293=65, srv1061625540=5, srv572529245=81, srv658691858=88, srv1684793654=43, srv10377812=3, srv1052131090=4, srv868723063=96, srv1005932285=0, srv1037677359=2, srv2133123090=63, srv386567965=74, srv1211982643=15, srv1246654233=18, srv156862370=34, srv752999968=92, srv2070307311=58, srv367321917=72, srv1063359006=6, srv1499131325=32, srv2053382347=57, srv231280946=67, srv746327886=90, srv622813646=84, srv1748666232=45, srv556139096=79, srv22743104=66, srv1752344111=46, srv2137816620=64, srv1236274586=16, srv920712072=97, srv649386917=86, srv1156462510=12, srv1476564162=30, srv2074940884=59, srv1246876366=19, srv1950505748=52, srv1159495338=13, srv640347099=85, srv1546830352=33, srv605319538=83, srv960352924=99, srv1135765057=11, srv64939472=87, srv25901391=68, srv340893365=71, srv1992892206=53, srv1774098179=48, srv1993145381=54, srv2050610978=56, srv1650430525=39, srv2110791263=62, srv1304014356=20, srv452091242=76, srv1240926202=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:32,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:32,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:32,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:32,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:32,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:32,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:32,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:32,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:32,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:32,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:32,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:32,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:32,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:32,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:32,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:32,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:32,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:32,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 04:53:32,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 04:53:32,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 04:53:32,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 04:53:32,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 04:53:32,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 04:53:32,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 04:53:32,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04109609335312651, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05570283508170091, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04109609335312651, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:32,383 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 04:53:32,384 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18117916245023521, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04109609335312651, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05570283508170091, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04109609335312651, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 04:53:32,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 461 ms to try 5000 different iterations.  Found a solution that moves 2681 regions; Going from a computed imbalance of 0.18117916245023521 to a new imbalance of 0.015047031255133132. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020372512896202774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03178914820946414, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29788888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020372512896202774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:32,733 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1449322838:76 , srv315830269:80 , srv602911677:80 , srv920712072:80 , srv960352924:80 , srv1378901658:81 , srv192849611:81 , srv231280946:81 , srv386567965:81 , srv1063359006:82 , srv1246876366:82 , srv1356082129:82 , srv283308642:82 , srv443081849:82 , srv649386917:82 , srv92217577:82 , srv1105543244:83 , srv1322859542:83 , srv136333362:83 , srv1412095293:83 , srv1628174482:83 , srv2074940884:83 , srv452091242:83 , srv556139096:83 , srv1211982643:84 , srv1658567345:84 , srv2029834638:84 , srv2110791263:84 , srv2133123090:84 , srv2137816620:84 , srv22743104:84 , srv376322145:84 , srv675516185:84 , srv10377812:85 , srv1052131090:85 , srv1061625540:85 , srv1067642603:85 , srv1352400711:85 , srv1490637560:85 , srv1574002366:85 , srv2085202659:85 , srv2147159293:85 , srv25901391:85 , srv475673017:85 , srv746327886:85 , srv842089724:85 , srv1159495338:86 , srv1160786536:86 , srv1650430525:86 , srv1752344111:86 , srv1992892206:86 , srv2091903272:86 , srv572529245:86 , srv64939472:86 , srv1135765057:87 , srv1156462510:87 , srv1546830352:87 , srv1648588239:87 , srv1663276973:87 , srv1774098179:87 , srv2053382347:87 , srv340893365:87 , srv605319538:87 , srv622813646:87 , srv640347099:87 , srv1005932285:88 , srv1246654233:88 , srv1499131325:88 , srv156862370:88 , srv1759797352:88 , srv1993145381:88 , srv2070307311:88 , srv567118414:88 , srv1031674438:89 , srv1037677359:89 , srv1083799801:89 , srv1236274586:89 , srv1240926202:89 , srv1304014356:89 , srv1418666654:89 , srv1476564162:89 , srv1595678116:89 , srv1748666232:89 , srv1944923628:89 , srv504178869:89 , srv751009606:89 , srv771162264:89 , srv852245250:89 , srv1077489403:90 , srv1313152104:90 , srv2050610978:90 , srv367321917:90 , srv658691858:90 , srv752999968:90 , srv1651709557:91 , srv1838567578:91 , srv1950505748:91 , srv1741931695:92 , srv868723063:92 , srv1684793654:500 }
2023-10-15 04:53:32,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:32,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1352400711=23, srv1105543244=10, srv1067642603=7, srv1313152104=21, srv1077489403=8, srv751009606=91, srv2029834638=55, srv1449322838=29, srv675516185=89, srv1651709557=40, srv1741931695=44, srv1322859542=22, srv1944923628=51, srv1031674438=1, srv1083799801=9, srv1490637560=31, srv1412095293=27, srv1628174482=37, srv1595678116=36, srv1759797352=47, srv842089724=94, srv443081849=75, srv1838567578=49, srv1378901658=26, srv475673017=77, srv136333362=25, srv1663276973=42, srv771162264=93, srv2085202659=60, srv602911677=82, srv567118414=80, srv192849611=50, srv315830269=70, srv1574002366=35, srv2091903272=61, srv1356082129=24, srv1658567345=41, srv1418666654=28, srv1160786536=14, srv376322145=73, srv283308642=69, srv852245250=95, srv504178869=78, srv92217577=98, srv1648588239=38, srv2147159293=65, srv1061625540=5, srv572529245=81, srv658691858=88, srv1684793654=43, srv10377812=3, srv1052131090=4, srv868723063=96, srv1005932285=0, srv1037677359=2, srv2133123090=63, srv386567965=74, srv1211982643=15, srv1246654233=18, srv156862370=34, srv752999968=92, srv2070307311=58, srv367321917=72, srv1063359006=6, srv1499131325=32, srv2053382347=57, srv231280946=67, srv746327886=90, srv622813646=84, srv1748666232=45, srv556139096=79, srv22743104=66, srv1752344111=46, srv2137816620=64, srv1236274586=16, srv920712072=97, srv649386917=86, srv1156462510=12, srv1476564162=30, srv2074940884=59, srv1246876366=19, srv1950505748=52, srv1159495338=13, srv640347099=85, srv1546830352=33, srv605319538=83, srv960352924=99, srv1135765057=11, srv64939472=87, srv25901391=68, srv340893365=71, srv1992892206=53, srv1774098179=48, srv1993145381=54, srv2050610978=56, srv1650430525=39, srv2110791263=62, srv1304014356=20, srv452091242=76, srv1240926202=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 04:53:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 04:53:32,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 04:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 04:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 04:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 04:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 04:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 04:53:32,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020372512896202774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03178914820946414, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020372512896202774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:32,898 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 04:53:32,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015028258491894817, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020372512896202774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03178914820946414, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020372512896202774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 04:53:33,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 493 ms to try 5000 different iterations.  Found a solution that moves 1002 regions; Going from a computed imbalance of 0.015028258491894817 to a new imbalance of 6.686503218768297E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0059824743002341195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.11133333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059824743002341195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:33,276 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv752999968:81 , srv1236274586:82 , srv852245250:82 , srv868723063:82 , srv1031674438:83 , srv1650430525:83 , srv2053382347:83 , srv2070307311:83 , srv340893365:83 , srv567118414:83 , srv751009606:83 , srv1067642603:84 , srv1156462510:84 , srv1240926202:84 , srv1418666654:84 , srv1476564162:84 , srv1499131325:84 , srv1546830352:84 , srv1944923628:84 , srv1993145381:84 , srv376322145:84 , srv556139096:84 , srv602911677:84 , srv622813646:84 , srv746327886:84 , srv1005932285:85 , srv1037677359:85 , srv1052131090:85 , srv1061625540:85 , srv1077489403:85 , srv1083799801:85 , srv1135765057:85 , srv1246654233:85 , srv1304014356:85 , srv1352400711:85 , srv1356082129:85 , srv1412095293:85 , srv1595678116:85 , srv1628174482:85 , srv1648588239:85 , srv1658567345:85 , srv1752344111:85 , srv1759797352:85 , srv2029834638:85 , srv2085202659:85 , srv2091903272:85 , srv25901391:85 , srv452091242:85 , srv475673017:85 , srv504178869:85 , srv640347099:85 , srv658691858:85 , srv771162264:85 , srv920712072:85 , srv10377812:86 , srv1063359006:86 , srv1105543244:86 , srv1313152104:86 , srv136333362:86 , srv156862370:86 , srv1574002366:86 , srv1663276973:86 , srv1741931695:86 , srv1748666232:86 , srv1838567578:86 , srv1950505748:86 , srv1992892206:86 , srv2074940884:86 , srv2110791263:86 , srv2133123090:86 , srv2137816620:86 , srv2147159293:86 , srv22743104:86 , srv283308642:86 , srv315830269:86 , srv367321917:86 , srv443081849:86 , srv842089724:86 , srv1160786536:87 , srv1211982643:87 , srv1322859542:87 , srv1378901658:87 , srv1449322838:87 , srv1490637560:87 , srv1651709557:87 , srv1774098179:87 , srv192849611:87 , srv231280946:87 , srv386567965:87 , srv572529245:87 , srv605319538:87 , srv649386917:87 , srv675516185:87 , srv92217577:87 , srv960352924:87 , srv1159495338:88 , srv1246876366:88 , srv2050610978:88 , srv64939472:88 , srv1684793654:556 }
2023-10-15 04:53:33,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:33,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1352400711=23, srv1105543244=10, srv1067642603=7, srv1313152104=21, srv1077489403=8, srv751009606=91, srv2029834638=55, srv1449322838=29, srv675516185=89, srv1651709557=40, srv1741931695=44, srv1322859542=22, srv1944923628=51, srv1031674438=1, srv1083799801=9, srv1490637560=31, srv1412095293=27, srv1628174482=37, srv1595678116=36, srv1759797352=47, srv842089724=94, srv443081849=75, srv1838567578=49, srv1378901658=26, srv475673017=77, srv136333362=25, srv1663276973=42, srv771162264=93, srv2085202659=60, srv602911677=82, srv567118414=80, srv192849611=50, srv315830269=70, srv1574002366=35, srv2091903272=61, srv1356082129=24, srv1658567345=41, srv1418666654=28, srv1160786536=14, srv376322145=73, srv283308642=69, srv852245250=95, srv504178869=78, srv92217577=98, srv1648588239=38, srv2147159293=65, srv1061625540=5, srv572529245=81, srv658691858=88, srv1684793654=43, srv10377812=3, srv1052131090=4, srv868723063=96, srv1005932285=0, srv1037677359=2, srv2133123090=63, srv386567965=74, srv1211982643=15, srv1246654233=18, srv156862370=34, srv752999968=92, srv2070307311=58, srv367321917=72, srv1063359006=6, srv1499131325=32, srv2053382347=57, srv231280946=67, srv746327886=90, srv622813646=84, srv1748666232=45, srv556139096=79, srv22743104=66, srv1752344111=46, srv2137816620=64, srv1236274586=16, srv920712072=97, srv649386917=86, srv1156462510=12, srv1476564162=30, srv2074940884=59, srv1246876366=19, srv1950505748=52, srv1159495338=13, srv640347099=85, srv1546830352=33, srv605319538=83, srv960352924=99, srv1135765057=11, srv64939472=87, srv25901391=68, srv340893365=71, srv1992892206=53, srv1774098179=48, srv1993145381=54, srv2050610978=56, srv1650430525=39, srv2110791263=62, srv1304014356=20, srv452091242=76, srv1240926202=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:33,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:33,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:33,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 04:53:33,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 04:53:33,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 04:53:33,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 04:53:33,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 04:53:33,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 04:53:33,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0059824743002341195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059824743002341195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:33,428 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 04:53:33,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.616341679175641E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0059824743002341195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059824743002341195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 04:53:33,693 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 236 regions; Going from a computed imbalance of 6.616341679175641E-4 to a new imbalance of 2.7198825943017236E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.026222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:33,694 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1246876366:83 , srv1412095293:83 , srv572529245:83 , srv605319538:83 , srv1005932285:84 , srv1031674438:84 , srv10377812:84 , srv1061625540:84 , srv1135765057:84 , srv1156462510:84 , srv1159495338:84 , srv1160786536:84 , srv1211982643:84 , srv136333362:84 , srv1476564162:84 , srv1490637560:84 , srv156862370:84 , srv1574002366:84 , srv1651709557:84 , srv1741931695:84 , srv1774098179:84 , srv1944923628:84 , srv1992892206:84 , srv2029834638:84 , srv2050610978:84 , srv2074940884:84 , srv2085202659:84 , srv2110791263:84 , srv2133123090:84 , srv2147159293:84 , srv231280946:84 , srv315830269:84 , srv376322145:84 , srv386567965:84 , srv443081849:84 , srv452091242:84 , srv504178869:84 , srv556139096:84 , srv567118414:84 , srv640347099:84 , srv64939472:84 , srv675516185:84 , srv751009606:84 , srv771162264:84 , srv842089724:84 , srv920712072:84 , srv92217577:84 , srv1037677359:85 , srv1052131090:85 , srv1063359006:85 , srv1067642603:85 , srv1077489403:85 , srv1083799801:85 , srv1240926202:85 , srv1246654233:85 , srv1304014356:85 , srv1313152104:85 , srv1322859542:85 , srv1352400711:85 , srv1356082129:85 , srv1378901658:85 , srv1418666654:85 , srv1449322838:85 , srv1499131325:85 , srv1546830352:85 , srv1595678116:85 , srv1628174482:85 , srv1648588239:85 , srv1658567345:85 , srv1663276973:85 , srv1748666232:85 , srv1752344111:85 , srv1759797352:85 , srv1838567578:85 , srv192849611:85 , srv1950505748:85 , srv1993145381:85 , srv2053382347:85 , srv2070307311:85 , srv2091903272:85 , srv2137816620:85 , srv22743104:85 , srv25901391:85 , srv283308642:85 , srv340893365:85 , srv367321917:85 , srv622813646:85 , srv649386917:85 , srv658691858:85 , srv746327886:85 , srv752999968:85 , srv852245250:85 , srv868723063:85 , srv960352924:85 , srv1105543244:86 , srv1236274586:86 , srv1650430525:86 , srv475673017:86 , srv602911677:86 , srv1684793654:631 }
2023-10-15 04:53:33,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:33,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1352400711=23, srv1105543244=10, srv1067642603=7, srv1313152104=21, srv1077489403=8, srv751009606=91, srv2029834638=55, srv1449322838=29, srv675516185=89, srv1651709557=40, srv1741931695=44, srv1322859542=22, srv1944923628=51, srv1031674438=1, srv1083799801=9, srv1490637560=31, srv1412095293=27, srv1628174482=37, srv1595678116=36, srv1759797352=47, srv842089724=94, srv443081849=75, srv1838567578=49, srv1378901658=26, srv475673017=77, srv136333362=25, srv1663276973=42, srv771162264=93, srv2085202659=60, srv602911677=82, srv567118414=80, srv192849611=50, srv315830269=70, srv1574002366=35, srv2091903272=61, srv1356082129=24, srv1658567345=41, srv1418666654=28, srv1160786536=14, srv376322145=73, srv283308642=69, srv852245250=95, srv504178869=78, srv92217577=98, srv1648588239=38, srv2147159293=65, srv1061625540=5, srv572529245=81, srv658691858=88, srv1684793654=43, srv10377812=3, srv1052131090=4, srv868723063=96, srv1005932285=0, srv1037677359=2, srv2133123090=63, srv386567965=74, srv1211982643=15, srv1246654233=18, srv156862370=34, srv752999968=92, srv2070307311=58, srv367321917=72, srv1063359006=6, srv1499131325=32, srv2053382347=57, srv231280946=67, srv746327886=90, srv622813646=84, srv1748666232=45, srv556139096=79, srv22743104=66, srv1752344111=46, srv2137816620=64, srv1236274586=16, srv920712072=97, srv649386917=86, srv1156462510=12, srv1476564162=30, srv2074940884=59, srv1246876366=19, srv1950505748=52, srv1159495338=13, srv640347099=85, srv1546830352=33, srv605319538=83, srv960352924=99, srv1135765057=11, srv64939472=87, srv25901391=68, srv340893365=71, srv1992892206=53, srv1774098179=48, srv1993145381=54, srv2050610978=56, srv1650430525=39, srv2110791263=62, srv1304014356=20, srv452091242=76, srv1240926202=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:33,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:33,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:33,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 04:53:33,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 04:53:33,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 04:53:33,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 04:53:33,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 04:53:33,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 04:53:33,827 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:33,827 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 04:53:33,827 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5546318623270077E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 04:53:34,041 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 308 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 2.5546318623270077E-5 to a new imbalance of 7.822462643889748E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:34,041 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1105543244:83 , srv1595678116:83 , srv1748666232:83 , srv1752344111:83 , srv192849611:83 , srv2053382347:83 , srv602911677:83 , srv649386917:83 , srv752999968:83 , srv1005932285:84 , srv1031674438:84 , srv1037677359:84 , srv1052131090:84 , srv1061625540:84 , srv1063359006:84 , srv1067642603:84 , srv1077489403:84 , srv1083799801:84 , srv1135765057:84 , srv1156462510:84 , srv1159495338:84 , srv1160786536:84 , srv1236274586:84 , srv1240926202:84 , srv1246654233:84 , srv1304014356:84 , srv1313152104:84 , srv1322859542:84 , srv1352400711:84 , srv1356082129:84 , srv136333362:84 , srv1378901658:84 , srv1412095293:84 , srv1418666654:84 , srv1449322838:84 , srv1476564162:84 , srv1490637560:84 , srv1499131325:84 , srv1546830352:84 , srv156862370:84 , srv1574002366:84 , srv1628174482:84 , srv1648588239:84 , srv1650430525:84 , srv1651709557:84 , srv1658567345:84 , srv1663276973:84 , srv1741931695:84 , srv1759797352:84 , srv1774098179:84 , srv1838567578:84 , srv1950505748:84 , srv1992892206:84 , srv1993145381:84 , srv2050610978:84 , srv2070307311:84 , srv2091903272:84 , srv2110791263:84 , srv2133123090:84 , srv2137816620:84 , srv2147159293:84 , srv22743104:84 , srv231280946:84 , srv25901391:84 , srv283308642:84 , srv315830269:84 , srv340893365:84 , srv367321917:84 , srv376322145:84 , srv386567965:84 , srv443081849:84 , srv452091242:84 , srv475673017:84 , srv504178869:84 , srv556139096:84 , srv567118414:84 , srv622813646:84 , srv640347099:84 , srv64939472:84 , srv658691858:84 , srv675516185:84 , srv746327886:84 , srv751009606:84 , srv771162264:84 , srv842089724:84 , srv852245250:84 , srv868723063:84 , srv920712072:84 , srv92217577:84 , srv960352924:84 , srv10377812:85 , srv1211982643:85 , srv1246876366:85 , srv1944923628:85 , srv2029834638:85 , srv2074940884:85 , srv2085202659:85 , srv572529245:85 , srv605319538:85 , srv1684793654:684 }
2023-10-15 04:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1352400711=23, srv1105543244=10, srv1067642603=7, srv1313152104=21, srv1077489403=8, srv751009606=91, srv2029834638=55, srv1449322838=29, srv675516185=89, srv1651709557=40, srv1741931695=44, srv1322859542=22, srv1944923628=51, srv1031674438=1, srv1083799801=9, srv1490637560=31, srv1412095293=27, srv1628174482=37, srv1595678116=36, srv1759797352=47, srv842089724=94, srv443081849=75, srv1838567578=49, srv1378901658=26, srv475673017=77, srv136333362=25, srv1663276973=42, srv771162264=93, srv2085202659=60, srv602911677=82, srv567118414=80, srv192849611=50, srv315830269=70, srv1574002366=35, srv2091903272=61, srv1356082129=24, srv1658567345=41, srv1418666654=28, srv1160786536=14, srv376322145=73, srv283308642=69, srv852245250=95, srv504178869=78, srv92217577=98, srv1648588239=38, srv2147159293=65, srv1061625540=5, srv572529245=81, srv658691858=88, srv1684793654=43, srv10377812=3, srv1052131090=4, srv868723063=96, srv1005932285=0, srv1037677359=2, srv2133123090=63, srv386567965=74, srv1211982643=15, srv1246654233=18, srv156862370=34, srv752999968=92, srv2070307311=58, srv367321917=72, srv1063359006=6, srv1499131325=32, srv2053382347=57, srv231280946=67, srv746327886=90, srv622813646=84, srv1748666232=45, srv556139096=79, srv22743104=66, srv1752344111=46, srv2137816620=64, srv1236274586=16, srv920712072=97, srv649386917=86, srv1156462510=12, srv1476564162=30, srv2074940884=59, srv1246876366=19, srv1950505748=52, srv1159495338=13, srv640347099=85, srv1546830352=33, srv605319538=83, srv960352924=99, srv1135765057=11, srv64939472=87, srv25901391=68, srv340893365=71, srv1992892206=53, srv1774098179=48, srv1993145381=54, srv2050610978=56, srv1650430525=39, srv2110791263=62, srv1304014356=20, srv452091242=76, srv1240926202=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:34,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:34,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 04:53:34,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 04:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 04:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 04:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 04:53:34,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:34,170 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1105543244:83 , srv1595678116:83 , srv1748666232:83 , srv1752344111:83 , srv192849611:83 , srv2053382347:83 , srv602911677:83 , srv649386917:83 , srv752999968:83 , srv1005932285:84 , srv1031674438:84 , srv1037677359:84 , srv1052131090:84 , srv1061625540:84 , srv1063359006:84 , srv1067642603:84 , srv1077489403:84 , srv1083799801:84 , srv1135765057:84 , srv1156462510:84 , srv1159495338:84 , srv1160786536:84 , srv1236274586:84 , srv1240926202:84 , srv1246654233:84 , srv1304014356:84 , srv1313152104:84 , srv1322859542:84 , srv1352400711:84 , srv1356082129:84 , srv136333362:84 , srv1378901658:84 , srv1412095293:84 , srv1418666654:84 , srv1449322838:84 , srv1476564162:84 , srv1490637560:84 , srv1499131325:84 , srv1546830352:84 , srv156862370:84 , srv1574002366:84 , srv1628174482:84 , srv1648588239:84 , srv1650430525:84 , srv1651709557:84 , srv1658567345:84 , srv1663276973:84 , srv1741931695:84 , srv1759797352:84 , srv1774098179:84 , srv1838567578:84 , srv1950505748:84 , srv1992892206:84 , srv1993145381:84 , srv2050610978:84 , srv2070307311:84 , srv2091903272:84 , srv2110791263:84 , srv2133123090:84 , srv2137816620:84 , srv2147159293:84 , srv22743104:84 , srv231280946:84 , srv25901391:84 , srv283308642:84 , srv315830269:84 , srv340893365:84 , srv367321917:84 , srv376322145:84 , srv386567965:84 , srv443081849:84 , srv452091242:84 , srv475673017:84 , srv504178869:84 , srv556139096:84 , srv567118414:84 , srv622813646:84 , srv640347099:84 , srv64939472:84 , srv658691858:84 , srv675516185:84 , srv746327886:84 , srv751009606:84 , srv771162264:84 , srv842089724:84 , srv852245250:84 , srv868723063:84 , srv920712072:84 , srv92217577:84 , srv960352924:84 , srv10377812:85 , srv1211982643:85 , srv1246876366:85 , srv1944923628:85 , srv2029834638:85 , srv2074940884:85 , srv2085202659:85 , srv572529245:85 , srv605319538:85 , srv1684793654:684 }
2023-10-15 04:53:34,208 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=335 (was 338), ProcessCount=173 (was 173), AvailableMemoryMB=6093 (was 6873)
2023-10-15 04:53:34,216 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=173, AvailableMemoryMB=6092
2023-10-15 04:53:34,217 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-15 04:53:34,218 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-15 04:53:34,232 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1044566191:84 , srv1088242674:84 , srv1097425360:84 , srv1103628101:84 , srv119566340:84 , srv1280783395:84 , srv1311859849:84 , srv1451866399:84 , srv1459982778:84 , srv1498693078:84 , srv1504399417:84 , srv1666081246:84 , srv1709515106:84 , srv1739833644:84 , srv1878847054:84 , srv2092738098:84 , srv231192100:84 , srv356150626:84 , srv468724942:84 , srv595622022:84 , srv65696542:84 , srv657697026:84 , srv687780595:84 , srv694409759:84 , srv700500747:84 , srv770720145:84 , srv947832734:84 , srv950738027:84 , srv972061234:84 , srv1870577830:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-15 04:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:53:34,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595622022=20, srv231192100=17, srv1044566191=0, srv1666081246=11, srv356150626=18, srv657697026=22, srv700500747=25, srv1311859849=6, srv468724942=19, srv972061234=29, srv1498693078=9, srv687780595=23, srv1870577830=14, srv1088242674=1, srv1739833644=13, srv1504399417=10, srv950738027=28, srv1878847054=15, srv947832734=27, srv119566340=4, srv770720145=26, srv694409759=24, srv1459982778=8, srv2092738098=16, srv1280783395=5, srv1103628101=3, srv65696542=21, srv1709515106=12, srv1451866399=7, srv1097425360=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:53:34,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:53:34,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-15 04:53:34,262 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1695021453433068, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:53:34,262 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912727138989501, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1695021453433068, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-15 04:55:34,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6143184 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912727138989501 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:55:34,257 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1044566191:90 , srv1088242674:90 , srv1097425360:90 , srv1103628101:90 , srv119566340:90 , srv1280783395:90 , srv1311859849:90 , srv1451866399:90 , srv1459982778:90 , srv1498693078:90 , srv1504399417:90 , srv1666081246:90 , srv1709515106:90 , srv1739833644:90 , srv1870577830:90 , srv1878847054:90 , srv2092738098:90 , srv231192100:90 , srv356150626:90 , srv468724942:90 , srv595622022:90 , srv65696542:90 , srv657697026:90 , srv687780595:90 , srv694409759:90 , srv700500747:90 , srv770720145:90 , srv947832734:90 , srv950738027:90 , srv972061234:90 }
2023-10-15 04:55:34,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 04:55:34,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv595622022=20, srv231192100=17, srv1044566191=0, srv1666081246=11, srv356150626=18, srv657697026=22, srv700500747=25, srv1311859849=6, srv468724942=19, srv972061234=29, srv1498693078=9, srv687780595=23, srv1870577830=14, srv1088242674=1, srv1739833644=13, srv1504399417=10, srv950738027=28, srv1878847054=15, srv947832734=27, srv119566340=4, srv770720145=26, srv694409759=24, srv1459982778=8, srv2092738098=16, srv1280783395=5, srv1103628101=3, srv65696542=21, srv1709515106=12, srv1451866399=7, srv1097425360=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 04:55:34,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 04:55:34,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-15 04:55:34,281 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 04:55:34,282 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1044566191:90 , srv1088242674:90 , srv1097425360:90 , srv1103628101:90 , srv119566340:90 , srv1280783395:90 , srv1311859849:90 , srv1451866399:90 , srv1459982778:90 , srv1498693078:90 , srv1504399417:90 , srv1666081246:90 , srv1709515106:90 , srv1739833644:90 , srv1870577830:90 , srv1878847054:90 , srv2092738098:90 , srv231192100:90 , srv356150626:90 , srv468724942:90 , srv595622022:90 , srv65696542:90 , srv657697026:90 , srv687780595:90 , srv694409759:90 , srv700500747:90 , srv770720145:90 , srv947832734:90 , srv950738027:90 , srv972061234:90 }
2023-10-15 04:55:34,297 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 335), ProcessCount=173 (was 173), AvailableMemoryMB=6495 (was 6092) - AvailableMemoryMB LEAK? -