2024-02-09 21:52:57,706 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-09 21:52:58,039 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-09 21:52:58,152 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-09 21:52:58,232 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-09 21:52:58,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-09 21:52:58,255 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=165, AvailableMemoryMB=4029
2024-02-09 21:52:58,258 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-09 21:52:58,258 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-09 21:52:58,403 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033289905:84 , srv1062423663:84 , srv1067004107:84 , srv1130623266:84 , srv1180844595:84 , srv1206806038:84 , srv1211662899:84 , srv1235034053:84 , srv1238331455:84 , srv1247866905:84 , srv1247896038:84 , srv1306986644:84 , srv1321161728:84 , srv1330387490:84 , srv1341340585:84 , srv1402437406:84 , srv1402701629:84 , srv1460056498:84 , srv1477644216:84 , srv1478997729:84 , srv1496247232:84 , srv1499251126:84 , srv1534112341:84 , srv1543777224:84 , srv1616420173:84 , srv1634191354:84 , srv1648257834:84 , srv1670842105:84 , srv1676801545:84 , srv1678412601:84 , srv174146128:84 , srv1750499030:84 , srv1769632065:84 , srv1772319431:84 , srv1826507359:84 , srv1861661718:84 , srv1865352640:84 , srv1884380741:84 , srv1916583003:84 , srv19198453:84 , srv1937488416:84 , srv1946862391:84 , srv1954653654:84 , srv1978777751:84 , srv1993905612:84 , srv2063564955:84 , srv2079756366:84 , srv2113353495:84 , srv233454773:84 , srv274928007:84 , srv277968344:84 , srv279868829:84 , srv291536591:84 , srv298149636:84 , srv377272343:84 , srv383568533:84 , srv38380053:84 , srv389554031:84 , srv404551612:84 , srv446714927:84 , srv448839826:84 , srv470551664:84 , srv487165862:84 , srv50109266:84 , srv548506132:84 , srv562981664:84 , srv578082358:84 , srv578736396:84 , srv588978878:84 , srv589302676:84 , srv595819241:84 , srv612226293:84 , srv617818086:84 , srv621417298:84 , srv631793630:84 , srv632060268:84 , srv637495059:84 , srv639164042:84 , srv650425582:84 , srv655439039:84 , srv690065662:84 , srv706103670:84 , srv732643188:84 , srv761532049:84 , srv764115016:84 , srv77413683:84 , srv778220851:84 , srv789436319:84 , srv802631272:84 , srv833559356:84 , srv872572722:84 , srv877723431:84 , srv892622250:84 , srv896973609:84 , srv964372656:84 , srv969533627:84 , srv975263684:84 , srv980656889:84 , srv985660916:84 , srv1395618727:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-09 21:52:58,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:52:58,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1247866905=9, srv1954653654=43, srv404551612=59, srv2063564955=46, srv639164042=78, srv1670842105=28, srv470551664=62, srv1826507359=35, srv1496247232=21, srv1321161728=12, srv377272343=55, srv77413683=86, srv298149636=54, srv631793630=75, srv690065662=81, srv802631272=89, srv1211662899=6, srv1634191354=26, srv632060268=76, srv1534112341=23, srv637495059=77, srv778220851=87, srv448839826=61, srv1861661718=36, srv975263684=97, srv174146128=31, srv233454773=49, srv1477644216=19, srv1478997729=20, srv1402437406=16, srv277968344=51, srv1772319431=34, srv789436319=88, srv1341340585=14, srv1865352640=37, srv2113353495=48, srv761532049=84, srv1769632065=33, srv1247896038=10, srv38380053=57, srv1067004107=2, srv1402701629=17, srv1130623266=3, srv291536591=53, srv1937488416=41, srv1676801545=29, srv562981664=66, srv964372656=95, srv1206806038=5, srv1238331455=8, srv706103670=82, srv1750499030=32, srv578082358=67, srv1460056498=18, srv1678412601=30, srv892622250=93, srv578736396=68, srv1033289905=0, srv1062423663=1, srv764115016=85, srv1884380741=38, srv655439039=80, srv50109266=64, srv589302676=70, srv1499251126=22, srv588978878=69, srv1978777751=44, srv1993905612=45, srv612226293=72, srv1330387490=13, srv1616420173=25, srv896973609=94, srv389554031=58, srv980656889=98, srv985660916=99, srv383568533=56, srv19198453=40, srv1180844595=4, srv621417298=74, srv595819241=71, srv877723431=92, srv446714927=60, srv650425582=79, srv279868829=52, srv1946862391=42, srv2079756366=47, srv548506132=65, srv1395618727=15, srv1543777224=24, srv487165862=63, srv617818086=73, srv1306986644=11, srv274928007=50, srv1916583003=39, srv1235034053=7, srv1648257834=27, srv732643188=83, srv833559356=90, srv872572722=91, srv969533627=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:52:58,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:52:58,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:52:58,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:52:58,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 21:52:58,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 21:52:58,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 21:52:58,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 21:52:58,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 21:52:58,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 21:52:58,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 21:52:58,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 21:52:58,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 21:52:58,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 21:52:58,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 21:52:58,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 21:52:58,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 21:52:58,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 21:52:58,706 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:58,706 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 21:52:58,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 21:52:59,042 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 510 ms to try 5000 different iterations.  Found a solution that moves 4683 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1774062432684824. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04162163672264408, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05802008243987564, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5203333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04162163672264408, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:59,056 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1235034053:82 , srv1861661718:82 , srv19198453:82 , srv778220851:82 , srv896973609:82 , srv964372656:82 , srv1180844595:83 , srv1247866905:83 , srv1477644216:83 , srv1993905612:83 , srv446714927:83 , srv470551664:83 , srv632060268:83 , srv985660916:83 , srv1330387490:84 , srv1648257834:84 , srv1978777751:84 , srv2063564955:84 , srv279868829:84 , srv298149636:84 , srv588978878:84 , srv617818086:84 , srv655439039:84 , srv706103670:84 , srv892622250:84 , srv969533627:84 , srv1033289905:85 , srv1247896038:85 , srv1499251126:85 , srv1670842105:85 , srv1750499030:85 , srv1772319431:85 , srv1884380741:85 , srv2113353495:85 , srv389554031:85 , srv404551612:85 , srv578736396:85 , srv639164042:85 , srv650425582:85 , srv761532049:85 , srv789436319:85 , srv1062423663:86 , srv1238331455:86 , srv1402437406:86 , srv1478997729:86 , srv1634191354:86 , srv1676801545:86 , srv1769632065:86 , srv1865352640:86 , srv1916583003:86 , srv1937488416:86 , srv383568533:86 , srv487165862:86 , srv562981664:86 , srv621417298:86 , srv637495059:86 , srv833559356:86 , srv1321161728:87 , srv1402701629:87 , srv1534112341:87 , srv1678412601:87 , srv1826507359:87 , srv274928007:87 , srv291536591:87 , srv578082358:87 , srv612226293:87 , srv690065662:87 , srv77413683:87 , srv975263684:87 , srv1211662899:88 , srv1543777224:88 , srv1616420173:88 , srv1946862391:88 , srv1954653654:88 , srv277968344:88 , srv38380053:88 , srv732643188:88 , srv764115016:88 , srv877723431:88 , srv980656889:88 , srv1130623266:89 , srv1306986644:89 , srv1460056498:89 , srv174146128:89 , srv233454773:89 , srv589302676:89 , srv802631272:89 , srv872572722:89 , srv1206806038:90 , srv1341340585:90 , srv2079756366:90 , srv1067004107:91 , srv1496247232:91 , srv377272343:91 , srv448839826:91 , srv50109266:91 , srv548506132:91 , srv631793630:92 , srv595819241:93 , srv1395618727:460 }
2024-02-09 21:52:59,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:52:59,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1247866905=9, srv1954653654=43, srv404551612=59, srv2063564955=46, srv639164042=78, srv1670842105=28, srv470551664=62, srv1826507359=35, srv1496247232=21, srv1321161728=12, srv377272343=55, srv77413683=86, srv298149636=54, srv631793630=75, srv690065662=81, srv802631272=89, srv1211662899=6, srv1634191354=26, srv632060268=76, srv1534112341=23, srv637495059=77, srv778220851=87, srv448839826=61, srv1861661718=36, srv975263684=97, srv174146128=31, srv233454773=49, srv1477644216=19, srv1478997729=20, srv1402437406=16, srv277968344=51, srv1772319431=34, srv789436319=88, srv1341340585=14, srv1865352640=37, srv2113353495=48, srv761532049=84, srv1769632065=33, srv1247896038=10, srv38380053=57, srv1067004107=2, srv1402701629=17, srv1130623266=3, srv291536591=53, srv1937488416=41, srv1676801545=29, srv562981664=66, srv964372656=95, srv1206806038=5, srv1238331455=8, srv706103670=82, srv1750499030=32, srv578082358=67, srv1460056498=18, srv1678412601=30, srv892622250=93, srv578736396=68, srv1033289905=0, srv1062423663=1, srv764115016=85, srv1884380741=38, srv655439039=80, srv50109266=64, srv589302676=70, srv1499251126=22, srv588978878=69, srv1978777751=44, srv1993905612=45, srv612226293=72, srv1330387490=13, srv1616420173=25, srv896973609=94, srv389554031=58, srv980656889=98, srv985660916=99, srv383568533=56, srv19198453=40, srv1180844595=4, srv621417298=74, srv595819241=71, srv877723431=92, srv446714927=60, srv650425582=79, srv279868829=52, srv1946862391=42, srv2079756366=47, srv548506132=65, srv1395618727=15, srv1543777224=24, srv487165862=63, srv617818086=73, srv1306986644=11, srv274928007=50, srv1916583003=39, srv1235034053=7, srv1648257834=27, srv732643188=83, srv833559356=90, srv872572722=91, srv969533627=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:52:59,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:52:59,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:52:59,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:52:59,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:52:59,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 21:52:59,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 21:52:59,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 21:52:59,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 21:52:59,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 21:52:59,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 21:52:59,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 21:52:59,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 21:52:59,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 21:52:59,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 21:52:59,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 21:52:59,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 21:52:59,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 21:52:59,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 21:52:59,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 21:52:59,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 21:52:59,218 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04162163672264408, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05802008243987564, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04162163672264408, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:59,219 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 21:52:59,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17737345220162487, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04162163672264408, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05802008243987564, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04162163672264408, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 21:52:59,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 296 ms to try 5000 different iterations.  Found a solution that moves 2633 regions; Going from a computed imbalance of 0.17737345220162487 to a new imbalance of 0.014972628179062246. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022731537198118608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03281071791162978, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29255555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022731537198118608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042416666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:59,428 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1496247232:79 , srv595819241:79 , srv1341340585:80 , srv1067004107:81 , srv1306986644:81 , srv2079756366:81 , srv377272343:81 , srv548506132:81 , srv631793630:81 , srv802631272:81 , srv877723431:81 , srv1460056498:82 , srv1946862391:82 , srv50109266:82 , srv764115016:82 , srv1130623266:83 , srv1206806038:83 , srv1211662899:83 , srv174146128:83 , srv1769632065:83 , srv233454773:83 , srv38380053:83 , srv448839826:83 , srv1321161728:84 , srv1534112341:84 , srv1543777224:84 , srv1616420173:84 , srv1826507359:84 , srv1916583003:84 , srv1954653654:84 , srv2113353495:84 , srv274928007:84 , srv578082358:84 , srv589302676:84 , srv690065662:84 , srv732643188:84 , srv77413683:84 , srv980656889:84 , srv1978777751:85 , srv277968344:85 , srv389554031:85 , srv650425582:85 , srv761532049:85 , srv872572722:85 , srv1402437406:86 , srv1402701629:86 , srv1478997729:86 , srv1670842105:86 , srv1750499030:86 , srv1884380741:86 , srv383568533:86 , srv487165862:86 , srv612226293:86 , srv632060268:86 , srv1247896038:87 , srv1648257834:87 , srv1678412601:87 , srv1865352640:87 , srv1937488416:87 , srv291536591:87 , srv298149636:87 , srv578736396:87 , srv789436319:87 , srv833559356:87 , srv969533627:87 , srv975263684:87 , srv1033289905:88 , srv1062423663:88 , srv1238331455:88 , srv1247866905:88 , srv1330387490:88 , srv1634191354:88 , srv1772319431:88 , srv2063564955:88 , srv404551612:88 , srv588978878:88 , srv617818086:88 , srv621417298:88 , srv637495059:88 , srv639164042:88 , srv778220851:88 , srv892622250:88 , srv964372656:88 , srv1180844595:89 , srv1499251126:89 , srv1861661718:89 , srv19198453:89 , srv1993905612:89 , srv446714927:89 , srv655439039:89 , srv706103670:89 , srv1477644216:90 , srv1676801545:90 , srv279868829:90 , srv470551664:90 , srv562981664:90 , srv985660916:90 , srv1235034053:92 , srv896973609:92 , srv1395618727:516 }
2024-02-09 21:52:59,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:52:59,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1247866905=9, srv1954653654=43, srv404551612=59, srv2063564955=46, srv639164042=78, srv1670842105=28, srv470551664=62, srv1826507359=35, srv1496247232=21, srv1321161728=12, srv377272343=55, srv77413683=86, srv298149636=54, srv631793630=75, srv690065662=81, srv802631272=89, srv1211662899=6, srv1634191354=26, srv632060268=76, srv1534112341=23, srv637495059=77, srv778220851=87, srv448839826=61, srv1861661718=36, srv975263684=97, srv174146128=31, srv233454773=49, srv1477644216=19, srv1478997729=20, srv1402437406=16, srv277968344=51, srv1772319431=34, srv789436319=88, srv1341340585=14, srv1865352640=37, srv2113353495=48, srv761532049=84, srv1769632065=33, srv1247896038=10, srv38380053=57, srv1067004107=2, srv1402701629=17, srv1130623266=3, srv291536591=53, srv1937488416=41, srv1676801545=29, srv562981664=66, srv964372656=95, srv1206806038=5, srv1238331455=8, srv706103670=82, srv1750499030=32, srv578082358=67, srv1460056498=18, srv1678412601=30, srv892622250=93, srv578736396=68, srv1033289905=0, srv1062423663=1, srv764115016=85, srv1884380741=38, srv655439039=80, srv50109266=64, srv589302676=70, srv1499251126=22, srv588978878=69, srv1978777751=44, srv1993905612=45, srv612226293=72, srv1330387490=13, srv1616420173=25, srv896973609=94, srv389554031=58, srv980656889=98, srv985660916=99, srv383568533=56, srv19198453=40, srv1180844595=4, srv621417298=74, srv595819241=71, srv877723431=92, srv446714927=60, srv650425582=79, srv279868829=52, srv1946862391=42, srv2079756366=47, srv548506132=65, srv1395618727=15, srv1543777224=24, srv487165862=63, srv617818086=73, srv1306986644=11, srv274928007=50, srv1916583003=39, srv1235034053=7, srv1648257834=27, srv732643188=83, srv833559356=90, srv872572722=91, srv969533627=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:52:59,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:52:59,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:52:59,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 21:52:59,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 21:52:59,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 21:52:59,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 21:52:59,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 21:52:59,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 21:52:59,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 21:52:59,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 21:52:59,541 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022731537198118608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03281071791162978, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022731537198118608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042416666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:59,542 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 21:52:59,542 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01495419151900761, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022731537198118608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03281071791162978, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022731537198118608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042416666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 21:52:59,720 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 253 ms to try 5000 different iterations.  Found a solution that moves 944 regions; Going from a computed imbalance of 0.01495419151900761 to a new imbalance of 8.384805764460012E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0077897935083739624); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0098016238147137); MoveCostFunction : (multiplier=7.0, imbalance=0.10488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0077897935083739624); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:59,722 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1676801545:81 , srv279868829:82 , srv291536591:82 , srv562981664:82 , srv1062423663:83 , srv404551612:83 , srv448839826:83 , srv621417298:83 , srv872572722:83 , srv896973609:83 , srv975263684:83 , srv1235034053:84 , srv1238331455:84 , srv1402701629:84 , srv1499251126:84 , srv1634191354:84 , srv1865352640:84 , srv1937488416:84 , srv2063564955:84 , srv277968344:84 , srv470551664:84 , srv612226293:84 , srv637495059:84 , srv639164042:84 , srv706103670:84 , srv833559356:84 , srv985660916:84 , srv1033289905:85 , srv1130623266:85 , srv1206806038:85 , srv1247896038:85 , srv1330387490:85 , srv1402437406:85 , srv1477644216:85 , srv1616420173:85 , srv1648257834:85 , srv1678412601:85 , srv1772319431:85 , srv1826507359:85 , srv1954653654:85 , srv233454773:85 , srv274928007:85 , srv298149636:85 , srv383568533:85 , srv446714927:85 , srv487165862:85 , srv548506132:85 , srv589302676:85 , srv595819241:85 , srv617818086:85 , srv631793630:85 , srv732643188:85 , srv789436319:85 , srv1067004107:86 , srv1180844595:86 , srv1211662899:86 , srv1247866905:86 , srv1534112341:86 , srv1543777224:86 , srv174146128:86 , srv1750499030:86 , srv1884380741:86 , srv19198453:86 , srv1993905612:86 , srv2079756366:86 , srv377272343:86 , srv38380053:86 , srv578082358:86 , srv578736396:86 , srv588978878:86 , srv655439039:86 , srv764115016:86 , srv77413683:86 , srv778220851:86 , srv892622250:86 , srv964372656:86 , srv980656889:86 , srv1306986644:87 , srv1321161728:87 , srv1341340585:87 , srv1478997729:87 , srv1670842105:87 , srv1861661718:87 , srv1916583003:87 , srv1946862391:87 , srv389554031:87 , srv50109266:87 , srv690065662:87 , srv761532049:87 , srv802631272:87 , srv969533627:87 , srv1460056498:88 , srv1496247232:88 , srv1769632065:88 , srv1978777751:88 , srv2113353495:88 , srv650425582:88 , srv877723431:88 , srv632060268:89 , srv1395618727:551 }
2024-02-09 21:52:59,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:52:59,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1247866905=9, srv1954653654=43, srv404551612=59, srv2063564955=46, srv639164042=78, srv1670842105=28, srv470551664=62, srv1826507359=35, srv1496247232=21, srv1321161728=12, srv377272343=55, srv77413683=86, srv298149636=54, srv631793630=75, srv690065662=81, srv802631272=89, srv1211662899=6, srv1634191354=26, srv632060268=76, srv1534112341=23, srv637495059=77, srv778220851=87, srv448839826=61, srv1861661718=36, srv975263684=97, srv174146128=31, srv233454773=49, srv1477644216=19, srv1478997729=20, srv1402437406=16, srv277968344=51, srv1772319431=34, srv789436319=88, srv1341340585=14, srv1865352640=37, srv2113353495=48, srv761532049=84, srv1769632065=33, srv1247896038=10, srv38380053=57, srv1067004107=2, srv1402701629=17, srv1130623266=3, srv291536591=53, srv1937488416=41, srv1676801545=29, srv562981664=66, srv964372656=95, srv1206806038=5, srv1238331455=8, srv706103670=82, srv1750499030=32, srv578082358=67, srv1460056498=18, srv1678412601=30, srv892622250=93, srv578736396=68, srv1033289905=0, srv1062423663=1, srv764115016=85, srv1884380741=38, srv655439039=80, srv50109266=64, srv589302676=70, srv1499251126=22, srv588978878=69, srv1978777751=44, srv1993905612=45, srv612226293=72, srv1330387490=13, srv1616420173=25, srv896973609=94, srv389554031=58, srv980656889=98, srv985660916=99, srv383568533=56, srv19198453=40, srv1180844595=4, srv621417298=74, srv595819241=71, srv877723431=92, srv446714927=60, srv650425582=79, srv279868829=52, srv1946862391=42, srv2079756366=47, srv548506132=65, srv1395618727=15, srv1543777224=24, srv487165862=63, srv617818086=73, srv1306986644=11, srv274928007=50, srv1916583003=39, srv1235034053=7, srv1648257834=27, srv732643188=83, srv833559356=90, srv872572722=91, srv969533627=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:52:59,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:52:59,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 21:52:59,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 21:52:59,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 21:52:59,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 21:52:59,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 21:52:59,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 21:52:59,819 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0077897935083739624); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0098016238147137); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0077897935083739624); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:52:59,819 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 21:52:59,819 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.318705471670125E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0077897935083739624); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0098016238147137); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0077897935083739624); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 21:53:00,035 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 288 ms to try 5000 different iterations.  Found a solution that moves 301 regions; Going from a computed imbalance of 8.318705471670125E-4 to a new imbalance of 3.0297853004101223E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.03344444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:53:00,036 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv50109266:82 , srv1460056498:83 , srv1478997729:83 , srv1678412601:83 , srv631793630:83 , srv650425582:83 , srv655439039:83 , srv1033289905:84 , srv1067004107:84 , srv1130623266:84 , srv1180844595:84 , srv1206806038:84 , srv1235034053:84 , srv1238331455:84 , srv1321161728:84 , srv1477644216:84 , srv1496247232:84 , srv1499251126:84 , srv1543777224:84 , srv1634191354:84 , srv1670842105:84 , srv174146128:84 , srv1772319431:84 , srv1861661718:84 , srv1954653654:84 , srv1993905612:84 , srv377272343:84 , srv446714927:84 , srv562981664:84 , srv578736396:84 , srv588978878:84 , srv589302676:84 , srv632060268:84 , srv690065662:84 , srv969533627:84 , srv980656889:84 , srv1062423663:85 , srv1247866905:85 , srv1247896038:85 , srv1306986644:85 , srv1330387490:85 , srv1341340585:85 , srv1402437406:85 , srv1402701629:85 , srv1534112341:85 , srv1616420173:85 , srv1750499030:85 , srv1769632065:85 , srv1865352640:85 , srv1884380741:85 , srv1916583003:85 , srv19198453:85 , srv1937488416:85 , srv1946862391:85 , srv1978777751:85 , srv2079756366:85 , srv2113353495:85 , srv233454773:85 , srv277968344:85 , srv383568533:85 , srv38380053:85 , srv389554031:85 , srv448839826:85 , srv470551664:85 , srv487165862:85 , srv578082358:85 , srv595819241:85 , srv612226293:85 , srv617818086:85 , srv621417298:85 , srv637495059:85 , srv639164042:85 , srv706103670:85 , srv732643188:85 , srv761532049:85 , srv77413683:85 , srv789436319:85 , srv802631272:85 , srv833559356:85 , srv872572722:85 , srv877723431:85 , srv892622250:85 , srv896973609:85 , srv975263684:85 , srv985660916:85 , srv1211662899:86 , srv1648257834:86 , srv1676801545:86 , srv1826507359:86 , srv2063564955:86 , srv274928007:86 , srv279868829:86 , srv291536591:86 , srv298149636:86 , srv404551612:86 , srv548506132:86 , srv764115016:86 , srv778220851:86 , srv964372656:86 , srv1395618727:615 }
2024-02-09 21:53:00,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:53:00,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1247866905=9, srv1954653654=43, srv404551612=59, srv2063564955=46, srv639164042=78, srv1670842105=28, srv470551664=62, srv1826507359=35, srv1496247232=21, srv1321161728=12, srv377272343=55, srv77413683=86, srv298149636=54, srv631793630=75, srv690065662=81, srv802631272=89, srv1211662899=6, srv1634191354=26, srv632060268=76, srv1534112341=23, srv637495059=77, srv778220851=87, srv448839826=61, srv1861661718=36, srv975263684=97, srv174146128=31, srv233454773=49, srv1477644216=19, srv1478997729=20, srv1402437406=16, srv277968344=51, srv1772319431=34, srv789436319=88, srv1341340585=14, srv1865352640=37, srv2113353495=48, srv761532049=84, srv1769632065=33, srv1247896038=10, srv38380053=57, srv1067004107=2, srv1402701629=17, srv1130623266=3, srv291536591=53, srv1937488416=41, srv1676801545=29, srv562981664=66, srv964372656=95, srv1206806038=5, srv1238331455=8, srv706103670=82, srv1750499030=32, srv578082358=67, srv1460056498=18, srv1678412601=30, srv892622250=93, srv578736396=68, srv1033289905=0, srv1062423663=1, srv764115016=85, srv1884380741=38, srv655439039=80, srv50109266=64, srv589302676=70, srv1499251126=22, srv588978878=69, srv1978777751=44, srv1993905612=45, srv612226293=72, srv1330387490=13, srv1616420173=25, srv896973609=94, srv389554031=58, srv980656889=98, srv985660916=99, srv383568533=56, srv19198453=40, srv1180844595=4, srv621417298=74, srv595819241=71, srv877723431=92, srv446714927=60, srv650425582=79, srv279868829=52, srv1946862391=42, srv2079756366=47, srv548506132=65, srv1395618727=15, srv1543777224=24, srv487165862=63, srv617818086=73, srv1306986644=11, srv274928007=50, srv1916583003=39, srv1235034053=7, srv1648257834=27, srv732643188=83, srv833559356=90, srv872572722=91, srv969533627=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:53:00,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:53:00,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:53:00,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:53:00,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:53:00,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:53:00,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 21:53:00,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 21:53:00,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 21:53:00,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 21:53:00,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 21:53:00,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 21:53:00,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 21:53:00,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 21:53:00,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 21:53:00,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 21:53:00,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 21:53:00,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:53:00,138 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-09 21:53:00,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.8190205956457593E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-09 21:53:00,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 232 ms to try 5000 different iterations.  Found a solution that moves 40 regions; Going from a computed imbalance of 2.8190205956457593E-5 to a new imbalance of 8.810733549424091E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0044444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:53:00,298 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1211662899:83 , srv1676801545:83 , srv548506132:83 , srv637495059:83 , srv892622250:83 , srv1033289905:84 , srv1062423663:84 , srv1067004107:84 , srv1180844595:84 , srv1206806038:84 , srv1235034053:84 , srv1238331455:84 , srv1247866905:84 , srv1247896038:84 , srv1306986644:84 , srv1321161728:84 , srv1330387490:84 , srv1341340585:84 , srv1402437406:84 , srv1402701629:84 , srv1460056498:84 , srv1477644216:84 , srv1478997729:84 , srv1496247232:84 , srv1499251126:84 , srv1534112341:84 , srv1543777224:84 , srv1616420173:84 , srv1634191354:84 , srv1648257834:84 , srv1670842105:84 , srv1678412601:84 , srv174146128:84 , srv1750499030:84 , srv1769632065:84 , srv1772319431:84 , srv1826507359:84 , srv1861661718:84 , srv1865352640:84 , srv1884380741:84 , srv1916583003:84 , srv19198453:84 , srv1937488416:84 , srv1946862391:84 , srv1978777751:84 , srv1993905612:84 , srv2063564955:84 , srv2079756366:84 , srv2113353495:84 , srv233454773:84 , srv274928007:84 , srv277968344:84 , srv279868829:84 , srv291536591:84 , srv298149636:84 , srv377272343:84 , srv383568533:84 , srv38380053:84 , srv389554031:84 , srv404551612:84 , srv448839826:84 , srv470551664:84 , srv487165862:84 , srv50109266:84 , srv562981664:84 , srv578082358:84 , srv578736396:84 , srv588978878:84 , srv589302676:84 , srv595819241:84 , srv612226293:84 , srv617818086:84 , srv621417298:84 , srv632060268:84 , srv639164042:84 , srv655439039:84 , srv690065662:84 , srv706103670:84 , srv732643188:84 , srv761532049:84 , srv764115016:84 , srv77413683:84 , srv778220851:84 , srv789436319:84 , srv802631272:84 , srv833559356:84 , srv872572722:84 , srv877723431:84 , srv896973609:84 , srv964372656:84 , srv969533627:84 , srv975263684:84 , srv980656889:84 , srv985660916:84 , srv1130623266:85 , srv1954653654:85 , srv446714927:85 , srv631793630:85 , srv650425582:85 , srv1395618727:684 }
2024-02-09 21:53:00,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:53:00,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1247866905=9, srv1954653654=43, srv404551612=59, srv2063564955=46, srv639164042=78, srv1670842105=28, srv470551664=62, srv1826507359=35, srv1496247232=21, srv1321161728=12, srv377272343=55, srv77413683=86, srv298149636=54, srv631793630=75, srv690065662=81, srv802631272=89, srv1211662899=6, srv1634191354=26, srv632060268=76, srv1534112341=23, srv637495059=77, srv778220851=87, srv448839826=61, srv1861661718=36, srv975263684=97, srv174146128=31, srv233454773=49, srv1477644216=19, srv1478997729=20, srv1402437406=16, srv277968344=51, srv1772319431=34, srv789436319=88, srv1341340585=14, srv1865352640=37, srv2113353495=48, srv761532049=84, srv1769632065=33, srv1247896038=10, srv38380053=57, srv1067004107=2, srv1402701629=17, srv1130623266=3, srv291536591=53, srv1937488416=41, srv1676801545=29, srv562981664=66, srv964372656=95, srv1206806038=5, srv1238331455=8, srv706103670=82, srv1750499030=32, srv578082358=67, srv1460056498=18, srv1678412601=30, srv892622250=93, srv578736396=68, srv1033289905=0, srv1062423663=1, srv764115016=85, srv1884380741=38, srv655439039=80, srv50109266=64, srv589302676=70, srv1499251126=22, srv588978878=69, srv1978777751=44, srv1993905612=45, srv612226293=72, srv1330387490=13, srv1616420173=25, srv896973609=94, srv389554031=58, srv980656889=98, srv985660916=99, srv383568533=56, srv19198453=40, srv1180844595=4, srv621417298=74, srv595819241=71, srv877723431=92, srv446714927=60, srv650425582=79, srv279868829=52, srv1946862391=42, srv2079756366=47, srv548506132=65, srv1395618727=15, srv1543777224=24, srv487165862=63, srv617818086=73, srv1306986644=11, srv274928007=50, srv1916583003=39, srv1235034053=7, srv1648257834=27, srv732643188=83, srv833559356=90, srv872572722=91, srv969533627=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:53:00,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:53:00,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:53:00,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:53:00,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:53:00,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:53:00,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:53:00,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:53:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-09 21:53:00,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-09 21:53:00,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-09 21:53:00,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-09 21:53:00,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-09 21:53:00,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-09 21:53:00,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-09 21:53:00,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-09 21:53:00,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-09 21:53:00,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-09 21:53:00,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-09 21:53:00,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-09 21:53:00,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:53:00,419 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1211662899:83 , srv1676801545:83 , srv548506132:83 , srv637495059:83 , srv892622250:83 , srv1033289905:84 , srv1062423663:84 , srv1067004107:84 , srv1180844595:84 , srv1206806038:84 , srv1235034053:84 , srv1238331455:84 , srv1247866905:84 , srv1247896038:84 , srv1306986644:84 , srv1321161728:84 , srv1330387490:84 , srv1341340585:84 , srv1402437406:84 , srv1402701629:84 , srv1460056498:84 , srv1477644216:84 , srv1478997729:84 , srv1496247232:84 , srv1499251126:84 , srv1534112341:84 , srv1543777224:84 , srv1616420173:84 , srv1634191354:84 , srv1648257834:84 , srv1670842105:84 , srv1678412601:84 , srv174146128:84 , srv1750499030:84 , srv1769632065:84 , srv1772319431:84 , srv1826507359:84 , srv1861661718:84 , srv1865352640:84 , srv1884380741:84 , srv1916583003:84 , srv19198453:84 , srv1937488416:84 , srv1946862391:84 , srv1978777751:84 , srv1993905612:84 , srv2063564955:84 , srv2079756366:84 , srv2113353495:84 , srv233454773:84 , srv274928007:84 , srv277968344:84 , srv279868829:84 , srv291536591:84 , srv298149636:84 , srv377272343:84 , srv383568533:84 , srv38380053:84 , srv389554031:84 , srv404551612:84 , srv448839826:84 , srv470551664:84 , srv487165862:84 , srv50109266:84 , srv562981664:84 , srv578082358:84 , srv578736396:84 , srv588978878:84 , srv589302676:84 , srv595819241:84 , srv612226293:84 , srv617818086:84 , srv621417298:84 , srv632060268:84 , srv639164042:84 , srv655439039:84 , srv690065662:84 , srv706103670:84 , srv732643188:84 , srv761532049:84 , srv764115016:84 , srv77413683:84 , srv778220851:84 , srv789436319:84 , srv802631272:84 , srv833559356:84 , srv872572722:84 , srv877723431:84 , srv896973609:84 , srv964372656:84 , srv969533627:84 , srv975263684:84 , srv980656889:84 , srv985660916:84 , srv1130623266:85 , srv1954653654:85 , srv446714927:85 , srv631793630:85 , srv650425582:85 , srv1395618727:684 }
2024-02-09 21:53:00,442 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 400), ProcessCount=165 (was 165), AvailableMemoryMB=3430 (was 4029)
2024-02-09 21:53:00,448 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=165, AvailableMemoryMB=3429
2024-02-09 21:53:00,449 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-09 21:53:00,449 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-09 21:53:00,455 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv101424611:84 , srv117520807:84 , srv1282171132:84 , srv1288799561:84 , srv1446130720:84 , srv1498283118:84 , srv153100017:84 , srv1628709487:84 , srv1678504623:84 , srv1737984083:84 , srv1748478141:84 , srv1876480472:84 , srv188860297:84 , srv1975028233:84 , srv2061768027:84 , srv2081942798:84 , srv2100328614:84 , srv23327480:84 , srv284474009:84 , srv326075094:84 , srv363661882:84 , srv444777762:84 , srv498180212:84 , srv719367340:84 , srv772818763:84 , srv778624417:84 , srv862739694:84 , srv882857146:84 , srv925587367:84 , srv592952981:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-09 21:53:00,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:53:00,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1748478141=10, srv2061768027=14, srv862739694=27, srv1628709487=7, srv101424611=0, srv778624417=26, srv363661882=20, srv1678504623=8, srv153100017=6, srv1498283118=5, srv1288799561=3, srv772818763=25, srv592952981=23, srv23327480=17, srv117520807=1, srv1876480472=11, srv1975028233=13, srv284474009=18, srv1446130720=4, srv925587367=29, srv498180212=22, srv326075094=19, srv719367340=24, srv188860297=12, srv2100328614=16, srv882857146=28, srv1282171132=2, srv2081942798=15, srv444777762=21, srv1737984083=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:53:00,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:53:00,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-09 21:53:00,478 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.126836423568251, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:53:00,478 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912592700693352, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.126836423568251, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-09 21:55:00,468 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9735307 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912592700693352 to a new imbalance of 4.492834641861589E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059932912685673025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:55:00,475 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv101424611:90 , srv117520807:90 , srv1282171132:90 , srv1288799561:90 , srv1446130720:90 , srv1498283118:90 , srv153100017:90 , srv1628709487:90 , srv1678504623:90 , srv1737984083:90 , srv1748478141:90 , srv1876480472:90 , srv188860297:90 , srv1975028233:90 , srv2061768027:90 , srv2081942798:90 , srv2100328614:90 , srv23327480:90 , srv284474009:90 , srv326075094:90 , srv363661882:90 , srv444777762:90 , srv498180212:90 , srv592952981:90 , srv719367340:90 , srv772818763:90 , srv778624417:90 , srv862739694:90 , srv882857146:90 , srv925587367:90 }
2024-02-09 21:55:00,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-09 21:55:00,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1748478141=10, srv2061768027=14, srv862739694=27, srv1628709487=7, srv101424611=0, srv778624417=26, srv363661882=20, srv1678504623=8, srv153100017=6, srv1498283118=5, srv1288799561=3, srv772818763=25, srv592952981=23, srv23327480=17, srv117520807=1, srv1876480472=11, srv1975028233=13, srv284474009=18, srv1446130720=4, srv925587367=29, srv498180212=22, srv326075094=19, srv719367340=24, srv188860297=12, srv2100328614=16, srv882857146=28, srv1282171132=2, srv2081942798=15, srv444777762=21, srv1737984083=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-09 21:55:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-09 21:55:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-09 21:55:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-09 21:55:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-09 21:55:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-09 21:55:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-09 21:55:00,495 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.888466508816907E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059932912685673025); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-09 21:55:00,495 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv101424611:90 , srv117520807:90 , srv1282171132:90 , srv1288799561:90 , srv1446130720:90 , srv1498283118:90 , srv153100017:90 , srv1628709487:90 , srv1678504623:90 , srv1737984083:90 , srv1748478141:90 , srv1876480472:90 , srv188860297:90 , srv1975028233:90 , srv2061768027:90 , srv2081942798:90 , srv2100328614:90 , srv23327480:90 , srv284474009:90 , srv326075094:90 , srv363661882:90 , srv444777762:90 , srv498180212:90 , srv592952981:90 , srv719367340:90 , srv772818763:90 , srv778624417:90 , srv862739694:90 , srv882857146:90 , srv925587367:90 }
2024-02-09 21:55:00,508 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 392), ProcessCount=167 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=3352 (was 3429)