2023-07-28 20:57:30,115 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-28 20:57:30,505 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-28 20:57:30,665 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-28 20:57:30,749 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-28 20:57:30,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-28 20:57:30,774 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=874, ProcessCount=191, AvailableMemoryMB=1736
2023-07-28 20:57:30,778 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-28 20:57:30,779 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-28 20:57:30,954 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002094783:84 , srv1008016611:84 , srv1017905799:84 , srv1039404605:84 , srv1052487909:84 , srv1054516759:84 , srv1096128332:84 , srv1114869361:84 , srv1133276354:84 , srv1141712602:84 , srv1145577991:84 , srv1167698541:84 , srv1193288345:84 , srv1204908399:84 , srv1252430898:84 , srv1254577723:84 , srv1258875954:84 , srv1280679504:84 , srv1280984503:84 , srv1315109520:84 , srv1325028577:84 , srv1347874432:84 , srv1368541057:84 , srv1386472707:84 , srv1401519831:84 , srv1420429659:84 , srv1457864336:84 , srv147525971:84 , srv1480447387:84 , srv148168785:84 , srv1537414920:84 , srv1595130232:84 , srv1680199886:84 , srv1722011708:84 , srv1724832610:84 , srv1725274691:84 , srv172806750:84 , srv1793724378:84 , srv179722318:84 , srv1808361338:84 , srv181206450:84 , srv1814225796:84 , srv181423099:84 , srv1851445982:84 , srv1856358369:84 , srv185871228:84 , srv1893595416:84 , srv1902226355:84 , srv1985498888:84 , srv2006189727:84 , srv2023466346:84 , srv2051511568:84 , srv2098264939:84 , srv2109241489:84 , srv2119227385:84 , srv246385243:84 , srv347647888:84 , srv350000048:84 , srv358611020:84 , srv389806107:84 , srv400985614:84 , srv423891689:84 , srv433997143:84 , srv435459473:84 , srv438617361:84 , srv462905446:84 , srv492264465:84 , srv49553700:84 , srv51189245:84 , srv554609911:84 , srv566156764:84 , srv616440654:84 , srv627506563:84 , srv641284245:84 , srv686006754:84 , srv702094131:84 , srv717130947:84 , srv723720449:84 , srv727202038:84 , srv730518796:84 , srv731982474:84 , srv749771888:84 , srv768133001:84 , srv778033110:84 , srv793685800:84 , srv823164517:84 , srv848110947:84 , srv852535987:84 , srv853935870:84 , srv864059717:84 , srv875764567:84 , srv896935836:84 , srv916021021:84 , srv918751849:84 , srv970526354:84 , srv973430023:84 , srv977391072:84 , srv979305359:84 , srv988752501:84 , srv210369859:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-28 20:57:30,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:57:30,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv864059717=90, srv916021021=93, srv1017905799=2, srv423891689=62, srv1420429659=25, srv1725274691=35, srv438617361=65, srv1258875954=16, srv1722011708=33, srv749771888=82, srv979305359=98, srv853935870=89, srv1347874432=21, srv462905446=66, srv179722318=38, srv492264465=67, srv566156764=71, srv148168785=29, srv1793724378=37, srv1401519831=24, srv1133276354=8, srv1008016611=1, srv2098264939=52, srv768133001=83, srv1280679504=17, srv1985498888=48, srv1167698541=11, srv1902226355=47, srv723720449=78, srv1856358369=44, srv702094131=76, srv2023466346=50, srv1315109520=19, srv1808361338=39, srv1537414920=30, srv823164517=86, srv1386472707=23, srv852535987=88, srv358611020=59, srv1252430898=14, srv1039404605=3, srv616440654=72, srv181423099=42, srv717130947=77, srv350000048=58, srv977391072=97, srv400985614=61, srv778033110=84, srv1325028577=20, srv246385243=56, srv1204908399=13, srv1002094783=0, srv554609911=70, srv1114869361=7, srv896935836=92, srv875764567=91, srv1457864336=26, srv1595130232=31, srv181206450=40, srv1054516759=5, srv435459473=64, srv641284245=74, srv1280984503=18, srv1096128332=6, srv2006189727=49, srv389806107=60, srv1724832610=34, srv973430023=96, srv731982474=81, srv49553700=68, srv1814225796=41, srv988752501=99, srv727202038=79, srv1893595416=46, srv1145577991=10, srv1254577723=15, srv730518796=80, srv1141712602=9, srv185871228=45, srv347647888=57, srv1851445982=43, srv433997143=63, srv793685800=85, srv686006754=75, srv1480447387=28, srv210369859=53, srv918751849=94, srv1052487909=4, srv970526354=95, srv1368541057=22, srv848110947=87, srv2051511568=51, srv2119227385=55, srv51189245=69, srv147525971=27, srv2109241489=54, srv1680199886=32, srv172806750=36, srv627506563=73, srv1193288345=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:57:31,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:57:31,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:57:31,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:57:31,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:57:31,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:57:31,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:57:31,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:57:31,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:57:31,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:57:31,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:57:31,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:57:31,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:57:31,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:57:31,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:57:31,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:57:31,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-28 20:57:31,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-28 20:57:31,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-28 20:57:31,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-28 20:57:31,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-28 20:57:31,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-28 20:57:31,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-28 20:57:31,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-28 20:57:31,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-28 20:57:31,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-28 20:57:31,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-28 20:57:31,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-28 20:57:31,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-28 20:57:31,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-28 20:57:31,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-28 20:57:31,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-28 20:57:31,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-28 20:57:31,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-28 20:57:31,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-28 20:57:31,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-28 20:57:31,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-28 20:57:31,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-28 20:57:31,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-28 20:57:31,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-28 20:57:31,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-28 20:57:31,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-28 20:57:31,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-28 20:57:31,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-28 20:57:31,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-28 20:57:31,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-28 20:57:31,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-28 20:57:31,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:31,283 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-28 20:57:31,283 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-28 20:57:31,632 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 495 ms to try 5000 different iterations.  Found a solution that moves 4714 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1788533823097666. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0416285272509421, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0577855472631592, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5237777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0416285272509421, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:31,682 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1368541057:80 , srv1133276354:81 , srv1457864336:81 , srv179722318:81 , srv1017905799:82 , srv1851445982:82 , srv2023466346:82 , srv1280984503:83 , srv1893595416:83 , srv438617361:83 , srv627506563:83 , srv875764567:83 , srv970526354:83 , srv1167698541:84 , srv1193288345:84 , srv1254577723:84 , srv1724832610:84 , srv1793724378:84 , srv181423099:84 , srv358611020:84 , srv433997143:84 , srv492264465:84 , srv49553700:84 , srv554609911:84 , srv1039404605:85 , srv1252430898:85 , srv1315109520:85 , srv1347874432:85 , srv1856358369:85 , srv1902226355:85 , srv616440654:85 , srv853935870:85 , srv864059717:85 , srv896935836:85 , srv977391072:85 , srv988752501:85 , srv1002094783:86 , srv1114869361:86 , srv1258875954:86 , srv1280679504:86 , srv1325028577:86 , srv1386472707:86 , srv147525971:86 , srv1480447387:86 , srv148168785:86 , srv172806750:86 , srv181206450:86 , srv1985498888:86 , srv2098264939:86 , srv723720449:86 , srv768133001:86 , srv778033110:86 , srv823164517:86 , srv918751849:86 , srv1008016611:87 , srv1204908399:87 , srv1401519831:87 , srv1537414920:87 , srv1680199886:87 , srv350000048:87 , srv423891689:87 , srv566156764:87 , srv641284245:87 , srv686006754:87 , srv749771888:87 , srv852535987:87 , srv916021021:87 , srv973430023:87 , srv1054516759:88 , srv1141712602:88 , srv1145577991:88 , srv1595130232:88 , srv1808361338:88 , srv185871228:88 , srv2006189727:88 , srv2051511568:88 , srv246385243:88 , srv400985614:88 , srv727202038:88 , srv731982474:88 , srv1096128332:89 , srv1420429659:89 , srv1725274691:89 , srv1814225796:89 , srv2109241489:89 , srv435459473:89 , srv462905446:89 , srv702094131:89 , srv717130947:89 , srv793685800:89 , srv848110947:89 , srv979305359:89 , srv1722011708:90 , srv2119227385:90 , srv347647888:90 , srv51189245:90 , srv730518796:90 , srv389806107:91 , srv1052487909:98 , srv210369859:460 }
2023-07-28 20:57:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:57:31,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv864059717=90, srv916021021=93, srv1017905799=2, srv423891689=62, srv1420429659=25, srv1725274691=35, srv438617361=65, srv1258875954=16, srv1722011708=33, srv749771888=82, srv979305359=98, srv853935870=89, srv1347874432=21, srv462905446=66, srv179722318=38, srv492264465=67, srv566156764=71, srv148168785=29, srv1793724378=37, srv1401519831=24, srv1133276354=8, srv1008016611=1, srv2098264939=52, srv768133001=83, srv1280679504=17, srv1985498888=48, srv1167698541=11, srv1902226355=47, srv723720449=78, srv1856358369=44, srv702094131=76, srv2023466346=50, srv1315109520=19, srv1808361338=39, srv1537414920=30, srv823164517=86, srv1386472707=23, srv852535987=88, srv358611020=59, srv1252430898=14, srv1039404605=3, srv616440654=72, srv181423099=42, srv717130947=77, srv350000048=58, srv977391072=97, srv400985614=61, srv778033110=84, srv1325028577=20, srv246385243=56, srv1204908399=13, srv1002094783=0, srv554609911=70, srv1114869361=7, srv896935836=92, srv875764567=91, srv1457864336=26, srv1595130232=31, srv181206450=40, srv1054516759=5, srv435459473=64, srv641284245=74, srv1280984503=18, srv1096128332=6, srv2006189727=49, srv389806107=60, srv1724832610=34, srv973430023=96, srv731982474=81, srv49553700=68, srv1814225796=41, srv988752501=99, srv727202038=79, srv1893595416=46, srv1145577991=10, srv1254577723=15, srv730518796=80, srv1141712602=9, srv185871228=45, srv347647888=57, srv1851445982=43, srv433997143=63, srv793685800=85, srv686006754=75, srv1480447387=28, srv210369859=53, srv918751849=94, srv1052487909=4, srv970526354=95, srv1368541057=22, srv848110947=87, srv2051511568=51, srv2119227385=55, srv51189245=69, srv147525971=27, srv2109241489=54, srv1680199886=32, srv172806750=36, srv627506563=73, srv1193288345=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:57:31,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:57:31,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:57:31,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:57:31,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:57:31,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:57:31,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:57:31,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:57:31,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:57:31,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:57:31,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:57:31,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:57:31,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:57:31,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:57:31,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:57:31,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:57:31,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-28 20:57:31,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-28 20:57:31,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-28 20:57:31,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-28 20:57:31,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-28 20:57:31,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-28 20:57:31,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-28 20:57:31,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-28 20:57:31,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-28 20:57:31,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-28 20:57:31,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-28 20:57:31,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-28 20:57:31,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-28 20:57:31,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-28 20:57:31,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-28 20:57:31,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-28 20:57:31,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-28 20:57:31,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-28 20:57:31,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-28 20:57:31,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-28 20:57:31,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-28 20:57:31,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-28 20:57:31,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-28 20:57:31,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-28 20:57:31,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-28 20:57:31,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-28 20:57:31,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-28 20:57:31,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-28 20:57:31,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-28 20:57:31,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-28 20:57:31,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-28 20:57:31,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-28 20:57:31,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-28 20:57:31,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-28 20:57:31,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-28 20:57:31,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-28 20:57:31,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-28 20:57:31,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-28 20:57:31,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-28 20:57:31,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-28 20:57:31,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-28 20:57:31,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0416285272509421, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0577855472631592, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0416285272509421, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:31,927 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-28 20:57:31,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17882037417626961, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0416285272509421, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0577855472631592, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0416285272509421, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-28 20:57:32,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 461 ms to try 5000 different iterations.  Found a solution that moves 2674 regions; Going from a computed imbalance of 0.17882037417626961 to a new imbalance of 0.014723086582997362. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022886262693531164); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03381138678822875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2971111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022886262693531164); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04125, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:32,272 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1052487909:80 , srv389806107:80 , srv51189245:80 , srv1420429659:81 , srv1722011708:81 , srv1096128332:82 , srv1401519831:82 , srv1595130232:82 , srv1808361338:82 , srv462905446:82 , srv566156764:82 , srv979305359:82 , srv1252430898:83 , srv1280679504:83 , srv1725274691:83 , srv181206450:83 , srv185871228:83 , srv2051511568:83 , srv2098264939:83 , srv2119227385:83 , srv641284245:83 , srv702094131:83 , srv717130947:83 , srv731982474:83 , srv823164517:83 , srv1054516759:84 , srv1141712602:84 , srv1537414920:84 , srv1814225796:84 , srv2006189727:84 , srv246385243:84 , srv350000048:84 , srv916021021:84 , srv1002094783:85 , srv1204908399:85 , srv1258875954:85 , srv1325028577:85 , srv147525971:85 , srv148168785:85 , srv1985498888:85 , srv347647888:85 , srv423891689:85 , srv435459473:85 , srv723720449:85 , srv973430023:85 , srv1145577991:86 , srv1167698541:86 , srv1315109520:86 , srv1386472707:86 , srv1480447387:86 , srv1724832610:86 , srv172806750:86 , srv1793724378:86 , srv2109241489:86 , srv400985614:86 , srv554609911:86 , srv616440654:86 , srv627506563:86 , srv730518796:86 , srv749771888:86 , srv778033110:86 , srv848110947:86 , srv853935870:86 , srv864059717:86 , srv918751849:86 , srv1008016611:87 , srv1193288345:87 , srv1347874432:87 , srv1856358369:87 , srv358611020:87 , srv433997143:87 , srv438617361:87 , srv686006754:87 , srv727202038:87 , srv793685800:87 , srv1039404605:88 , srv1254577723:88 , srv181423099:88 , srv1902226355:88 , srv2023466346:88 , srv492264465:88 , srv49553700:88 , srv896935836:88 , srv977391072:88 , srv988752501:88 , srv1680199886:89 , srv768133001:89 , srv852535987:89 , srv970526354:89 , srv1133276354:90 , srv1280984503:90 , srv1851445982:90 , srv1893595416:90 , srv1017905799:91 , srv1457864336:91 , srv179722318:91 , srv1114869361:92 , srv1368541057:92 , srv875764567:93 , srv210369859:517 }
2023-07-28 20:57:32,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:57:32,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv864059717=90, srv916021021=93, srv1017905799=2, srv423891689=62, srv1420429659=25, srv1725274691=35, srv438617361=65, srv1258875954=16, srv1722011708=33, srv749771888=82, srv979305359=98, srv853935870=89, srv1347874432=21, srv462905446=66, srv179722318=38, srv492264465=67, srv566156764=71, srv148168785=29, srv1793724378=37, srv1401519831=24, srv1133276354=8, srv1008016611=1, srv2098264939=52, srv768133001=83, srv1280679504=17, srv1985498888=48, srv1167698541=11, srv1902226355=47, srv723720449=78, srv1856358369=44, srv702094131=76, srv2023466346=50, srv1315109520=19, srv1808361338=39, srv1537414920=30, srv823164517=86, srv1386472707=23, srv852535987=88, srv358611020=59, srv1252430898=14, srv1039404605=3, srv616440654=72, srv181423099=42, srv717130947=77, srv350000048=58, srv977391072=97, srv400985614=61, srv778033110=84, srv1325028577=20, srv246385243=56, srv1204908399=13, srv1002094783=0, srv554609911=70, srv1114869361=7, srv896935836=92, srv875764567=91, srv1457864336=26, srv1595130232=31, srv181206450=40, srv1054516759=5, srv435459473=64, srv641284245=74, srv1280984503=18, srv1096128332=6, srv2006189727=49, srv389806107=60, srv1724832610=34, srv973430023=96, srv731982474=81, srv49553700=68, srv1814225796=41, srv988752501=99, srv727202038=79, srv1893595416=46, srv1145577991=10, srv1254577723=15, srv730518796=80, srv1141712602=9, srv185871228=45, srv347647888=57, srv1851445982=43, srv433997143=63, srv793685800=85, srv686006754=75, srv1480447387=28, srv210369859=53, srv918751849=94, srv1052487909=4, srv970526354=95, srv1368541057=22, srv848110947=87, srv2051511568=51, srv2119227385=55, srv51189245=69, srv147525971=27, srv2109241489=54, srv1680199886=32, srv172806750=36, srv627506563=73, srv1193288345=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:57:32,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:57:32,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:57:32,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:57:32,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:57:32,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:57:32,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:57:32,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:57:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:57:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:57:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:57:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:57:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-28 20:57:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-28 20:57:32,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-28 20:57:32,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-28 20:57:32,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-28 20:57:32,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-28 20:57:32,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-28 20:57:32,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-28 20:57:32,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-28 20:57:32,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-28 20:57:32,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-28 20:57:32,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-28 20:57:32,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-28 20:57:32,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-28 20:57:32,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-28 20:57:32,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022886262693531164); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03381138678822875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022886262693531164); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04125, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:32,472 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-28 20:57:32,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014704362834806669, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022886262693531164); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03381138678822875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022886262693531164); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04125, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-28 20:57:32,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 379 ms to try 5000 different iterations.  Found a solution that moves 1006 regions; Going from a computed imbalance of 0.014704362834806669 to a new imbalance of 6.130699382397182E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006120541647078519); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00808207060844344); MoveCostFunction : (multiplier=7.0, imbalance=0.11177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006120541647078519); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:32,733 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1052487909:80 , srv852535987:81 , srv875764567:81 , srv1114869361:82 , srv1680199886:82 , srv727202038:82 , srv730518796:82 , srv848110947:82 , srv1008016611:83 , srv1893595416:83 , srv2109241489:83 , srv347647888:83 , srv400985614:83 , srv435459473:83 , srv686006754:83 , srv768133001:83 , srv793685800:83 , srv1145577991:84 , srv1193288345:84 , srv1280984503:84 , srv1347874432:84 , srv1902226355:84 , srv749771888:84 , srv977391072:84 , srv988752501:84 , srv1002094783:85 , srv1017905799:85 , srv1039404605:85 , srv1204908399:85 , srv1254577723:85 , srv1368541057:85 , srv1386472707:85 , srv1725274691:85 , srv172806750:85 , srv179722318:85 , srv1851445982:85 , srv2006189727:85 , srv2119227385:85 , srv246385243:85 , srv731982474:85 , srv778033110:85 , srv896935836:85 , srv918751849:85 , srv973430023:85 , srv1054516759:86 , srv1096128332:86 , srv1141712602:86 , srv1457864336:86 , srv148168785:86 , srv1722011708:86 , srv1793724378:86 , srv1814225796:86 , srv181423099:86 , srv1856358369:86 , srv1985498888:86 , srv2051511568:86 , srv350000048:86 , srv358611020:86 , srv389806107:86 , srv423891689:86 , srv462905446:86 , srv492264465:86 , srv49553700:86 , srv616440654:86 , srv702094131:86 , srv853935870:86 , srv916021021:86 , srv970526354:86 , srv979305359:86 , srv1133276354:87 , srv1167698541:87 , srv1258875954:87 , srv1325028577:87 , srv147525971:87 , srv1480447387:87 , srv1537414920:87 , srv1595130232:87 , srv185871228:87 , srv433997143:87 , srv438617361:87 , srv51189245:87 , srv641284245:87 , srv717130947:87 , srv723720449:87 , srv864059717:87 , srv1315109520:88 , srv1401519831:88 , srv1420429659:88 , srv1724832610:88 , srv1808361338:88 , srv2023466346:88 , srv2098264939:88 , srv566156764:88 , srv823164517:88 , srv1252430898:89 , srv1280679504:89 , srv181206450:89 , srv554609911:89 , srv627506563:89 , srv210369859:535 }
2023-07-28 20:57:32,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:57:32,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv864059717=90, srv916021021=93, srv1017905799=2, srv423891689=62, srv1420429659=25, srv1725274691=35, srv438617361=65, srv1258875954=16, srv1722011708=33, srv749771888=82, srv979305359=98, srv853935870=89, srv1347874432=21, srv462905446=66, srv179722318=38, srv492264465=67, srv566156764=71, srv148168785=29, srv1793724378=37, srv1401519831=24, srv1133276354=8, srv1008016611=1, srv2098264939=52, srv768133001=83, srv1280679504=17, srv1985498888=48, srv1167698541=11, srv1902226355=47, srv723720449=78, srv1856358369=44, srv702094131=76, srv2023466346=50, srv1315109520=19, srv1808361338=39, srv1537414920=30, srv823164517=86, srv1386472707=23, srv852535987=88, srv358611020=59, srv1252430898=14, srv1039404605=3, srv616440654=72, srv181423099=42, srv717130947=77, srv350000048=58, srv977391072=97, srv400985614=61, srv778033110=84, srv1325028577=20, srv246385243=56, srv1204908399=13, srv1002094783=0, srv554609911=70, srv1114869361=7, srv896935836=92, srv875764567=91, srv1457864336=26, srv1595130232=31, srv181206450=40, srv1054516759=5, srv435459473=64, srv641284245=74, srv1280984503=18, srv1096128332=6, srv2006189727=49, srv389806107=60, srv1724832610=34, srv973430023=96, srv731982474=81, srv49553700=68, srv1814225796=41, srv988752501=99, srv727202038=79, srv1893595416=46, srv1145577991=10, srv1254577723=15, srv730518796=80, srv1141712602=9, srv185871228=45, srv347647888=57, srv1851445982=43, srv433997143=63, srv793685800=85, srv686006754=75, srv1480447387=28, srv210369859=53, srv918751849=94, srv1052487909=4, srv970526354=95, srv1368541057=22, srv848110947=87, srv2051511568=51, srv2119227385=55, srv51189245=69, srv147525971=27, srv2109241489=54, srv1680199886=32, srv172806750=36, srv627506563=73, srv1193288345=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:57:32,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:57:32,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:57:32,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:57:32,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-28 20:57:32,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-28 20:57:32,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-28 20:57:32,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-28 20:57:32,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-28 20:57:32,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-28 20:57:32,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-28 20:57:32,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-28 20:57:32,864 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006120541647078519); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00808207060844344); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006120541647078519); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:32,864 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-28 20:57:32,865 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.060257756818128E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006120541647078519); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00808207060844344); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006120541647078519); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-28 20:57:33,206 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 430 ms to try 5000 different iterations.  Found a solution that moves 254 regions; Going from a computed imbalance of 6.060257756818128E-4 to a new imbalance of 2.2031525027326312E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.02822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:33,207 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv793685800:82 , srv1114869361:83 , srv1315109520:83 , srv1325028577:83 , srv1480447387:83 , srv1814225796:83 , srv554609911:83 , srv717130947:83 , srv1008016611:84 , srv1017905799:84 , srv1039404605:84 , srv1054516759:84 , srv1133276354:84 , srv1141712602:84 , srv1258875954:84 , srv1280679504:84 , srv1401519831:84 , srv1420429659:84 , srv1457864336:84 , srv147525971:84 , srv148168785:84 , srv1537414920:84 , srv1680199886:84 , srv1722011708:84 , srv1724832610:84 , srv1808361338:84 , srv181206450:84 , srv181423099:84 , srv1856358369:84 , srv185871228:84 , srv1902226355:84 , srv1985498888:84 , srv2023466346:84 , srv2119227385:84 , srv347647888:84 , srv423891689:84 , srv492264465:84 , srv49553700:84 , srv627506563:84 , srv702094131:84 , srv723720449:84 , srv730518796:84 , srv768133001:84 , srv896935836:84 , srv970526354:84 , srv973430023:84 , srv979305359:84 , srv1052487909:85 , srv1096128332:85 , srv1145577991:85 , srv1204908399:85 , srv1252430898:85 , srv1280984503:85 , srv1368541057:85 , srv1386472707:85 , srv1725274691:85 , srv172806750:85 , srv179722318:85 , srv1851445982:85 , srv2006189727:85 , srv2051511568:85 , srv2098264939:85 , srv2109241489:85 , srv246385243:85 , srv350000048:85 , srv358611020:85 , srv389806107:85 , srv400985614:85 , srv433997143:85 , srv435459473:85 , srv438617361:85 , srv462905446:85 , srv51189245:85 , srv566156764:85 , srv616440654:85 , srv641284245:85 , srv686006754:85 , srv727202038:85 , srv731982474:85 , srv749771888:85 , srv778033110:85 , srv823164517:85 , srv848110947:85 , srv852535987:85 , srv853935870:85 , srv864059717:85 , srv875764567:85 , srv916021021:85 , srv918751849:85 , srv1002094783:86 , srv1167698541:86 , srv1254577723:86 , srv1347874432:86 , srv1595130232:86 , srv1793724378:86 , srv1893595416:86 , srv977391072:86 , srv988752501:86 , srv1193288345:87 , srv210369859:630 }
2023-07-28 20:57:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:57:33,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv864059717=90, srv916021021=93, srv1017905799=2, srv423891689=62, srv1420429659=25, srv1725274691=35, srv438617361=65, srv1258875954=16, srv1722011708=33, srv749771888=82, srv979305359=98, srv853935870=89, srv1347874432=21, srv462905446=66, srv179722318=38, srv492264465=67, srv566156764=71, srv148168785=29, srv1793724378=37, srv1401519831=24, srv1133276354=8, srv1008016611=1, srv2098264939=52, srv768133001=83, srv1280679504=17, srv1985498888=48, srv1167698541=11, srv1902226355=47, srv723720449=78, srv1856358369=44, srv702094131=76, srv2023466346=50, srv1315109520=19, srv1808361338=39, srv1537414920=30, srv823164517=86, srv1386472707=23, srv852535987=88, srv358611020=59, srv1252430898=14, srv1039404605=3, srv616440654=72, srv181423099=42, srv717130947=77, srv350000048=58, srv977391072=97, srv400985614=61, srv778033110=84, srv1325028577=20, srv246385243=56, srv1204908399=13, srv1002094783=0, srv554609911=70, srv1114869361=7, srv896935836=92, srv875764567=91, srv1457864336=26, srv1595130232=31, srv181206450=40, srv1054516759=5, srv435459473=64, srv641284245=74, srv1280984503=18, srv1096128332=6, srv2006189727=49, srv389806107=60, srv1724832610=34, srv973430023=96, srv731982474=81, srv49553700=68, srv1814225796=41, srv988752501=99, srv727202038=79, srv1893595416=46, srv1145577991=10, srv1254577723=15, srv730518796=80, srv1141712602=9, srv185871228=45, srv347647888=57, srv1851445982=43, srv433997143=63, srv793685800=85, srv686006754=75, srv1480447387=28, srv210369859=53, srv918751849=94, srv1052487909=4, srv970526354=95, srv1368541057=22, srv848110947=87, srv2051511568=51, srv2119227385=55, srv51189245=69, srv147525971=27, srv2109241489=54, srv1680199886=32, srv172806750=36, srv627506563=73, srv1193288345=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:57:33,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:57:33,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:57:33,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:57:33,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:57:33,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:57:33,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-28 20:57:33,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-28 20:57:33,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-28 20:57:33,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-28 20:57:33,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-28 20:57:33,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-28 20:57:33,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-28 20:57:33,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-28 20:57:33,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=2.0252979013700128E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:33,344 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv793685800:82 , srv1114869361:83 , srv1315109520:83 , srv1325028577:83 , srv1480447387:83 , srv1814225796:83 , srv554609911:83 , srv717130947:83 , srv1008016611:84 , srv1017905799:84 , srv1039404605:84 , srv1054516759:84 , srv1133276354:84 , srv1141712602:84 , srv1258875954:84 , srv1280679504:84 , srv1401519831:84 , srv1420429659:84 , srv1457864336:84 , srv147525971:84 , srv148168785:84 , srv1537414920:84 , srv1680199886:84 , srv1722011708:84 , srv1724832610:84 , srv1808361338:84 , srv181206450:84 , srv181423099:84 , srv1856358369:84 , srv185871228:84 , srv1902226355:84 , srv1985498888:84 , srv2023466346:84 , srv2119227385:84 , srv347647888:84 , srv423891689:84 , srv492264465:84 , srv49553700:84 , srv627506563:84 , srv702094131:84 , srv723720449:84 , srv730518796:84 , srv768133001:84 , srv896935836:84 , srv970526354:84 , srv973430023:84 , srv979305359:84 , srv1052487909:85 , srv1096128332:85 , srv1145577991:85 , srv1204908399:85 , srv1252430898:85 , srv1280984503:85 , srv1368541057:85 , srv1386472707:85 , srv1725274691:85 , srv172806750:85 , srv179722318:85 , srv1851445982:85 , srv2006189727:85 , srv2051511568:85 , srv2098264939:85 , srv2109241489:85 , srv246385243:85 , srv350000048:85 , srv358611020:85 , srv389806107:85 , srv400985614:85 , srv433997143:85 , srv435459473:85 , srv438617361:85 , srv462905446:85 , srv51189245:85 , srv566156764:85 , srv616440654:85 , srv641284245:85 , srv686006754:85 , srv727202038:85 , srv731982474:85 , srv749771888:85 , srv778033110:85 , srv823164517:85 , srv848110947:85 , srv852535987:85 , srv853935870:85 , srv864059717:85 , srv875764567:85 , srv916021021:85 , srv918751849:85 , srv1002094783:86 , srv1167698541:86 , srv1254577723:86 , srv1347874432:86 , srv1595130232:86 , srv1793724378:86 , srv1893595416:86 , srv977391072:86 , srv988752501:86 , srv1193288345:87 , srv210369859:630 }
2023-07-28 20:57:33,397 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=874 (was 874), ProcessCount=190 (was 191), AvailableMemoryMB=1185 (was 1736)
2023-07-28 20:57:33,413 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=874, ProcessCount=190, AvailableMemoryMB=1185
2023-07-28 20:57:33,414 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-28 20:57:33,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-28 20:57:33,434 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1068086146:84 , srv1211506609:84 , srv1227238045:84 , srv1302485010:84 , srv1340997641:84 , srv1462703853:84 , srv1588512050:84 , srv1598329403:84 , srv1612169855:84 , srv1653486413:84 , srv1721434895:84 , srv1735042597:84 , srv1931196217:84 , srv196030542:84 , srv2062420993:84 , srv260256111:84 , srv398529092:84 , srv429570839:84 , srv47752282:84 , srv509731553:84 , srv583571836:84 , srv608448143:84 , srv615106264:84 , srv666825541:84 , srv670915359:84 , srv687297699:84 , srv770459132:84 , srv788712592:84 , srv864204204:84 , srv514966516:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-28 20:57:33,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:57:33,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1612169855=8, srv429570839=17, srv1598329403=7, srv2062420993=14, srv615106264=23, srv666825541=24, srv687297699=26, srv864204204=29, srv1462703853=5, srv1653486413=9, srv670915359=25, srv514966516=20, srv583571836=21, srv47752282=18, srv509731553=19, srv788712592=28, srv1735042597=11, srv196030542=13, srv1068086146=0, srv1588512050=6, srv398529092=16, srv1721434895=10, srv608448143=22, srv1227238045=2, srv1340997641=4, srv260256111=15, srv770459132=27, srv1931196217=12, srv1302485010=3, srv1211506609=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:57:33,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:57:33,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:57:33,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:57:33,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:57:33,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:57:33,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:57:33,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:57:33,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:57:33,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:57:33,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:57:33,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:57:33,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-28 20:57:33,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0842177656300294, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:57:33,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912458410693819, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0842177656300294, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-28 20:59:33,465 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6025382 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912458410693819 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:59:33,485 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1068086146:90 , srv1211506609:90 , srv1227238045:90 , srv1302485010:90 , srv1340997641:90 , srv1462703853:90 , srv1588512050:90 , srv1598329403:90 , srv1612169855:90 , srv1653486413:90 , srv1721434895:90 , srv1735042597:90 , srv1931196217:90 , srv196030542:90 , srv2062420993:90 , srv260256111:90 , srv398529092:90 , srv429570839:90 , srv47752282:90 , srv509731553:90 , srv514966516:90 , srv583571836:90 , srv608448143:90 , srv615106264:90 , srv666825541:90 , srv670915359:90 , srv687297699:90 , srv770459132:90 , srv788712592:90 , srv864204204:90 }
2023-07-28 20:59:33,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-28 20:59:33,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1612169855=8, srv429570839=17, srv1598329403=7, srv2062420993=14, srv615106264=23, srv666825541=24, srv687297699=26, srv864204204=29, srv1462703853=5, srv1653486413=9, srv670915359=25, srv514966516=20, srv583571836=21, srv47752282=18, srv509731553=19, srv788712592=28, srv1735042597=11, srv196030542=13, srv1068086146=0, srv1588512050=6, srv398529092=16, srv1721434895=10, srv608448143=22, srv1227238045=2, srv1340997641=4, srv260256111=15, srv770459132=27, srv1931196217=12, srv1302485010=3, srv1211506609=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-28 20:59:33,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-28 20:59:33,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-28 20:59:33,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-28 20:59:33,528 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1068086146:90 , srv1211506609:90 , srv1227238045:90 , srv1302485010:90 , srv1340997641:90 , srv1462703853:90 , srv1588512050:90 , srv1598329403:90 , srv1612169855:90 , srv1653486413:90 , srv1721434895:90 , srv1735042597:90 , srv1931196217:90 , srv196030542:90 , srv2062420993:90 , srv260256111:90 , srv398529092:90 , srv429570839:90 , srv47752282:90 , srv509731553:90 , srv514966516:90 , srv583571836:90 , srv608448143:90 , srv615106264:90 , srv666825541:90 , srv670915359:90 , srv687297699:90 , srv770459132:90 , srv788712592:90 , srv864204204:90 }
2023-07-28 20:59:33,569 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1011 (was 874) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 190), AvailableMemoryMB=596 (was 1185)