2023-11-10 17:55:13,469 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-10 17:55:13,749 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-10 17:55:13,862 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-10 17:55:13,920 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-10 17:55:13,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-10 17:55:13,940 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=101, ProcessCount=168, AvailableMemoryMB=2991
2023-11-10 17:55:13,942 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-10 17:55:13,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-10 17:55:14,063 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014606352:84 , srv103212331:84 , srv1032626936:84 , srv1041363093:84 , srv106992336:84 , srv1088937172:84 , srv1106052875:84 , srv110829044:84 , srv1156076650:84 , srv1196135009:84 , srv1203355915:84 , srv1204749978:84 , srv1253052113:84 , srv1263380073:84 , srv1280769472:84 , srv129079906:84 , srv130060644:84 , srv1301811928:84 , srv1374250739:84 , srv138320111:84 , srv1400686088:84 , srv142129102:84 , srv142771394:84 , srv142969088:84 , srv1431634439:84 , srv1440698048:84 , srv146141364:84 , srv1488298350:84 , srv1501837532:84 , srv1536760043:84 , srv1538163398:84 , srv1542887536:84 , srv1558758142:84 , srv1571405400:84 , srv1601122429:84 , srv1683946953:84 , srv1711857449:84 , srv1726215695:84 , srv1754657954:84 , srv1805487706:84 , srv1810548509:84 , srv1850232880:84 , srv1861567205:84 , srv1877827048:84 , srv1896794048:84 , srv1913406469:84 , srv1946215734:84 , srv1965895055:84 , srv1970097582:84 , srv1983102496:84 , srv1983994218:84 , srv2007941580:84 , srv2048968593:84 , srv2064930563:84 , srv2071233642:84 , srv2082121754:84 , srv2110572916:84 , srv2115361272:84 , srv211585441:84 , srv2121104083:84 , srv2133153012:84 , srv259083556:84 , srv306799371:84 , srv33886312:84 , srv344628893:84 , srv388242337:84 , srv388772007:84 , srv394729081:84 , srv419757921:84 , srv430447900:84 , srv463096504:84 , srv50966765:84 , srv517743729:84 , srv524235584:84 , srv525910813:84 , srv535531963:84 , srv554649707:84 , srv560832937:84 , srv562510677:84 , srv573090940:84 , srv596793179:84 , srv683995072:84 , srv708396177:84 , srv714297180:84 , srv714948128:84 , srv757025169:84 , srv757498382:84 , srv771634934:84 , srv827925033:84 , srv841666653:84 , srv870781566:84 , srv877823340:84 , srv882526581:84 , srv904444968:84 , srv921402425:84 , srv952358351:84 , srv968282722:84 , srv980103922:84 , srv98510352:84 , srv873569037:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-10 17:55:14,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2110572916=56, srv535531963=75, srv1041363093=3, srv1970097582=48, srv1431634439=24, srv1014606352=0, srv1726215695=37, srv1983994218=50, srv1542887536=31, srv2133153012=60, srv142129102=21, srv211585441=58, srv394729081=67, srv1204749978=11, srv129079906=15, srv103212331=1, srv1301811928=17, srv50966765=71, srv1440698048=25, srv1810548509=40, srv1106052875=6, srv1805487706=39, srv757498382=86, srv683995072=81, srv525910813=74, srv1263380073=13, srv882526581=93, srv1754657954=38, srv463096504=70, srv1850232880=41, srv130060644=16, srv1400686088=20, srv980103922=98, srv1913406469=45, srv877823340=92, srv708396177=82, srv419757921=68, srv952358351=96, srv1861567205=42, srv146141364=26, srv1683946953=35, srv1374250739=18, srv2048968593=52, srv596793179=80, srv1488298350=27, srv560832937=77, srv870781566=90, srv1196135009=9, srv1965895055=47, srv388772007=66, srv827925033=88, srv841666653=89, srv430447900=69, srv714297180=83, srv2007941580=51, srv33886312=63, srv562510677=78, srv2071233642=54, srv1501837532=28, srv110829044=7, srv1032626936=2, srv1571405400=33, srv2115361272=57, srv259083556=61, srv921402425=95, srv524235584=73, srv1558758142=32, srv1538163398=30, srv142969088=23, srv1253052113=12, srv1203355915=10, srv757025169=85, srv1536760043=29, srv1896794048=44, srv2121104083=59, srv2064930563=53, srv1088937172=5, srv1946215734=46, srv1983102496=49, srv573090940=79, srv106992336=4, srv904444968=94, srv388242337=65, srv517743729=72, srv554649707=76, srv1280769472=14, srv138320111=19, srv344628893=64, srv714948128=84, srv1601122429=34, srv1156076650=8, srv873569037=91, srv98510352=99, srv2082121754=55, srv771634934=87, srv142771394=22, srv968282722=97, srv306799371=62, srv1877827048=43, srv1711857449=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 17:55:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 17:55:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 17:55:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 17:55:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 17:55:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 17:55:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 17:55:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 17:55:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 17:55:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 17:55:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 17:55:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 17:55:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 17:55:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 17:55:14,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:14,431 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 17:55:14,432 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 17:55:14,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 658 ms to try 5000 different iterations.  Found a solution that moves 4686 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17996998557728083. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03962821357487682, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05302732074346278, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5206666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03962821357487682, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23641666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:14,847 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1280769472:82 , srv1946215734:82 , srv952358351:82 , srv1088937172:83 , srv1301811928:83 , srv138320111:83 , srv1601122429:83 , srv1754657954:83 , srv1850232880:83 , srv388242337:83 , srv524235584:83 , srv980103922:83 , srv1014606352:84 , srv1253052113:84 , srv1440698048:84 , srv146141364:84 , srv1501837532:84 , srv1571405400:84 , srv1711857449:84 , srv1805487706:84 , srv1913406469:84 , srv1965895055:84 , srv1983102496:84 , srv1983994218:84 , srv2048968593:84 , srv2110572916:84 , srv306799371:84 , srv50966765:84 , srv535531963:84 , srv554649707:84 , srv757025169:84 , srv103212331:85 , srv1106052875:85 , srv1861567205:85 , srv2007941580:85 , srv259083556:85 , srv388772007:85 , srv419757921:85 , srv525910813:85 , srv708396177:85 , srv904444968:85 , srv968282722:85 , srv110829044:86 , srv1196135009:86 , srv142771394:86 , srv1810548509:86 , srv1877827048:86 , srv1970097582:86 , srv2071233642:86 , srv2121104083:86 , srv33886312:86 , srv596793179:86 , srv877823340:86 , srv98510352:86 , srv1041363093:87 , srv106992336:87 , srv1156076650:87 , srv1203355915:87 , srv1374250739:87 , srv142969088:87 , srv1536760043:87 , srv2082121754:87 , srv463096504:87 , srv517743729:87 , srv882526581:87 , srv1204749978:88 , srv1488298350:88 , srv1683946953:88 , srv1726215695:88 , srv1896794048:88 , srv2064930563:88 , srv344628893:88 , srv560832937:88 , srv683995072:88 , srv714297180:88 , srv757498382:88 , srv771634934:88 , srv827925033:88 , srv129079906:89 , srv130060644:89 , srv1400686088:89 , srv142129102:89 , srv1538163398:89 , srv1542887536:89 , srv2115361272:89 , srv2133153012:89 , srv430447900:89 , srv562510677:89 , srv1558758142:90 , srv714948128:90 , srv841666653:90 , srv870781566:90 , srv1431634439:91 , srv921402425:91 , srv1032626936:92 , srv211585441:93 , srv1263380073:94 , srv394729081:95 , srv573090940:95 , srv873569037:442 }
2023-11-10 17:55:14,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:14,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2110572916=56, srv535531963=75, srv1041363093=3, srv1970097582=48, srv1431634439=24, srv1014606352=0, srv1726215695=37, srv1983994218=50, srv1542887536=31, srv2133153012=60, srv142129102=21, srv211585441=58, srv394729081=67, srv1204749978=11, srv129079906=15, srv103212331=1, srv1301811928=17, srv50966765=71, srv1440698048=25, srv1810548509=40, srv1106052875=6, srv1805487706=39, srv757498382=86, srv683995072=81, srv525910813=74, srv1263380073=13, srv882526581=93, srv1754657954=38, srv463096504=70, srv1850232880=41, srv130060644=16, srv1400686088=20, srv980103922=98, srv1913406469=45, srv877823340=92, srv708396177=82, srv419757921=68, srv952358351=96, srv1861567205=42, srv146141364=26, srv1683946953=35, srv1374250739=18, srv2048968593=52, srv596793179=80, srv1488298350=27, srv560832937=77, srv870781566=90, srv1196135009=9, srv1965895055=47, srv388772007=66, srv827925033=88, srv841666653=89, srv430447900=69, srv714297180=83, srv2007941580=51, srv33886312=63, srv562510677=78, srv2071233642=54, srv1501837532=28, srv110829044=7, srv1032626936=2, srv1571405400=33, srv2115361272=57, srv259083556=61, srv921402425=95, srv524235584=73, srv1558758142=32, srv1538163398=30, srv142969088=23, srv1253052113=12, srv1203355915=10, srv757025169=85, srv1536760043=29, srv1896794048=44, srv2121104083=59, srv2064930563=53, srv1088937172=5, srv1946215734=46, srv1983102496=49, srv573090940=79, srv106992336=4, srv904444968=94, srv388242337=65, srv517743729=72, srv554649707=76, srv1280769472=14, srv138320111=19, srv344628893=64, srv714948128=84, srv1601122429=34, srv1156076650=8, srv873569037=91, srv98510352=99, srv2082121754=55, srv771634934=87, srv142771394=22, srv968282722=97, srv306799371=62, srv1877827048=43, srv1711857449=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:14,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:14,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:14,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:14,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 17:55:14,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 17:55:14,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 17:55:14,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 17:55:14,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 17:55:14,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 17:55:15,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03962821357487682, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05302732074346278, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03962821357487682, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23641666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:15,032 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 17:55:15,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17993717350397434, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03962821357487682, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05302732074346278, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03962821357487682, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23641666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 17:55:15,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 448 ms to try 5000 different iterations.  Found a solution that moves 2563 regions; Going from a computed imbalance of 0.17993717350397434 to a new imbalance of 0.01596592139970917. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02327152307022964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633921739028952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2847777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02327152307022964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:15,351 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv573090940:75 , srv394729081:77 , srv1263380073:79 , srv921402425:79 , srv211585441:80 , srv130060644:81 , srv1032626936:82 , srv129079906:82 , srv1683946953:82 , srv1896794048:82 , srv714948128:82 , srv771634934:82 , srv827925033:82 , srv882526581:82 , srv1204749978:83 , srv1400686088:83 , srv142129102:83 , srv1431634439:83 , srv1538163398:83 , srv1558758142:83 , srv1726215695:83 , srv562510677:83 , srv714297180:83 , srv841666653:83 , srv1156076650:84 , srv1196135009:84 , srv1374250739:84 , srv142969088:84 , srv1488298350:84 , srv1542887536:84 , srv2115361272:84 , srv2133153012:84 , srv430447900:84 , srv560832937:84 , srv870781566:84 , srv106992336:85 , srv1536760043:85 , srv1877827048:85 , srv344628893:85 , srv517743729:85 , srv683995072:85 , srv1106052875:86 , srv110829044:86 , srv1203355915:86 , srv1253052113:86 , srv142771394:86 , srv146141364:86 , srv1810548509:86 , srv1861567205:86 , srv2064930563:86 , srv2082121754:86 , srv2121104083:86 , srv259083556:86 , srv33886312:86 , srv419757921:86 , srv463096504:86 , srv596793179:86 , srv757498382:86 , srv877823340:86 , srv904444968:86 , srv98510352:86 , srv103212331:87 , srv1041363093:87 , srv1301811928:87 , srv1440698048:87 , srv1711857449:87 , srv1913406469:87 , srv1983994218:87 , srv2007941580:87 , srv2048968593:87 , srv2071233642:87 , srv2110572916:87 , srv388772007:87 , srv535531963:87 , srv708396177:87 , srv968282722:87 , srv1014606352:88 , srv1571405400:88 , srv1601122429:88 , srv1850232880:88 , srv1965895055:88 , srv1970097582:88 , srv388242337:88 , srv524235584:88 , srv554649707:88 , srv757025169:88 , srv1088937172:89 , srv138320111:89 , srv1501837532:89 , srv1754657954:89 , srv1983102496:89 , srv50966765:89 , srv525910813:89 , srv1280769472:90 , srv1805487706:90 , srv1946215734:90 , srv952358351:90 , srv980103922:90 , srv306799371:92 , srv873569037:539 }
2023-11-10 17:55:15,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2110572916=56, srv535531963=75, srv1041363093=3, srv1970097582=48, srv1431634439=24, srv1014606352=0, srv1726215695=37, srv1983994218=50, srv1542887536=31, srv2133153012=60, srv142129102=21, srv211585441=58, srv394729081=67, srv1204749978=11, srv129079906=15, srv103212331=1, srv1301811928=17, srv50966765=71, srv1440698048=25, srv1810548509=40, srv1106052875=6, srv1805487706=39, srv757498382=86, srv683995072=81, srv525910813=74, srv1263380073=13, srv882526581=93, srv1754657954=38, srv463096504=70, srv1850232880=41, srv130060644=16, srv1400686088=20, srv980103922=98, srv1913406469=45, srv877823340=92, srv708396177=82, srv419757921=68, srv952358351=96, srv1861567205=42, srv146141364=26, srv1683946953=35, srv1374250739=18, srv2048968593=52, srv596793179=80, srv1488298350=27, srv560832937=77, srv870781566=90, srv1196135009=9, srv1965895055=47, srv388772007=66, srv827925033=88, srv841666653=89, srv430447900=69, srv714297180=83, srv2007941580=51, srv33886312=63, srv562510677=78, srv2071233642=54, srv1501837532=28, srv110829044=7, srv1032626936=2, srv1571405400=33, srv2115361272=57, srv259083556=61, srv921402425=95, srv524235584=73, srv1558758142=32, srv1538163398=30, srv142969088=23, srv1253052113=12, srv1203355915=10, srv757025169=85, srv1536760043=29, srv1896794048=44, srv2121104083=59, srv2064930563=53, srv1088937172=5, srv1946215734=46, srv1983102496=49, srv573090940=79, srv106992336=4, srv904444968=94, srv388242337=65, srv517743729=72, srv554649707=76, srv1280769472=14, srv138320111=19, srv344628893=64, srv714948128=84, srv1601122429=34, srv1156076650=8, srv873569037=91, srv98510352=99, srv2082121754=55, srv771634934=87, srv142771394=22, srv968282722=97, srv306799371=62, srv1877827048=43, srv1711857449=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:15,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:15,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:15,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 17:55:15,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 17:55:15,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 17:55:15,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 17:55:15,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 17:55:15,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 17:55:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 17:55:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 17:55:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 17:55:15,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 17:55:15,520 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02327152307022964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633921739028952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02327152307022964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:15,520 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 17:55:15,521 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01594797489013073, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02327152307022964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633921739028952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02327152307022964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 17:55:15,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 367 ms to try 5000 different iterations.  Found a solution that moves 955 regions; Going from a computed imbalance of 0.01594797489013073 to a new imbalance of 0.001032978358839503. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0051295718918823304); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007506076849761332); MoveCostFunction : (multiplier=7.0, imbalance=0.10611111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0051295718918823304); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:15,775 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv306799371:81 , srv1041363093:83 , srv1983102496:83 , srv2064930563:83 , srv2071233642:83 , srv525910813:83 , srv757498382:83 , srv1032626936:84 , srv1203355915:84 , srv1558758142:84 , srv1805487706:84 , srv1970097582:84 , srv2121104083:84 , srv430447900:84 , srv463096504:84 , srv50966765:84 , srv757025169:84 , srv870781566:84 , srv110829044:85 , srv1204749978:85 , srv1280769472:85 , srv138320111:85 , srv1400686088:85 , srv142129102:85 , srv142969088:85 , srv1488298350:85 , srv1501837532:85 , srv1542887536:85 , srv1571405400:85 , srv1754657954:85 , srv1877827048:85 , srv2007941580:85 , srv2082121754:85 , srv2115361272:85 , srv211585441:85 , srv2133153012:85 , srv388772007:85 , srv394729081:85 , srv562510677:85 , srv683995072:85 , srv708396177:85 , srv877823340:85 , srv980103922:85 , srv98510352:85 , srv1014606352:86 , srv103212331:86 , srv106992336:86 , srv1088937172:86 , srv1263380073:86 , srv129079906:86 , srv1374250739:86 , srv142771394:86 , srv1431634439:86 , srv1538163398:86 , srv1601122429:86 , srv1810548509:86 , srv1946215734:86 , srv1965895055:86 , srv259083556:86 , srv344628893:86 , srv388242337:86 , srv419757921:86 , srv517743729:86 , srv535531963:86 , srv560832937:86 , srv596793179:86 , srv714948128:86 , srv841666653:86 , srv904444968:86 , srv952358351:86 , srv1106052875:87 , srv1156076650:87 , srv1196135009:87 , srv130060644:87 , srv1301811928:87 , srv1440698048:87 , srv146141364:87 , srv1536760043:87 , srv1683946953:87 , srv1726215695:87 , srv1850232880:87 , srv1861567205:87 , srv1913406469:87 , srv1983994218:87 , srv2048968593:87 , srv2110572916:87 , srv33886312:87 , srv524235584:87 , srv714297180:87 , srv771634934:87 , srv827925033:87 , srv921402425:87 , srv968282722:87 , srv1253052113:88 , srv1711857449:88 , srv1896794048:88 , srv554649707:88 , srv573090940:88 , srv882526581:88 , srv873569037:522 }
2023-11-10 17:55:15,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:15,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2110572916=56, srv535531963=75, srv1041363093=3, srv1970097582=48, srv1431634439=24, srv1014606352=0, srv1726215695=37, srv1983994218=50, srv1542887536=31, srv2133153012=60, srv142129102=21, srv211585441=58, srv394729081=67, srv1204749978=11, srv129079906=15, srv103212331=1, srv1301811928=17, srv50966765=71, srv1440698048=25, srv1810548509=40, srv1106052875=6, srv1805487706=39, srv757498382=86, srv683995072=81, srv525910813=74, srv1263380073=13, srv882526581=93, srv1754657954=38, srv463096504=70, srv1850232880=41, srv130060644=16, srv1400686088=20, srv980103922=98, srv1913406469=45, srv877823340=92, srv708396177=82, srv419757921=68, srv952358351=96, srv1861567205=42, srv146141364=26, srv1683946953=35, srv1374250739=18, srv2048968593=52, srv596793179=80, srv1488298350=27, srv560832937=77, srv870781566=90, srv1196135009=9, srv1965895055=47, srv388772007=66, srv827925033=88, srv841666653=89, srv430447900=69, srv714297180=83, srv2007941580=51, srv33886312=63, srv562510677=78, srv2071233642=54, srv1501837532=28, srv110829044=7, srv1032626936=2, srv1571405400=33, srv2115361272=57, srv259083556=61, srv921402425=95, srv524235584=73, srv1558758142=32, srv1538163398=30, srv142969088=23, srv1253052113=12, srv1203355915=10, srv757025169=85, srv1536760043=29, srv1896794048=44, srv2121104083=59, srv2064930563=53, srv1088937172=5, srv1946215734=46, srv1983102496=49, srv573090940=79, srv106992336=4, srv904444968=94, srv388242337=65, srv517743729=72, srv554649707=76, srv1280769472=14, srv138320111=19, srv344628893=64, srv714948128=84, srv1601122429=34, srv1156076650=8, srv873569037=91, srv98510352=99, srv2082121754=55, srv771634934=87, srv142771394=22, srv968282722=97, srv306799371=62, srv1877827048=43, srv1711857449=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:15,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:15,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 17:55:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 17:55:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 17:55:15,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 17:55:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 17:55:15,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 17:55:15,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 17:55:15,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 17:55:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 17:55:15,907 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0051295718918823304); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007506076849761332); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0051295718918823304); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:15,907 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 17:55:15,908 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.001026291305914255, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0051295718918823304); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007506076849761332); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0051295718918823304); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 17:55:16,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 480 ms to try 5000 different iterations.  Found a solution that moves 262 regions; Going from a computed imbalance of 0.001026291305914255 to a new imbalance of 3.741016691514236E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.029111111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:16,291 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1431634439:82 , srv554649707:82 , srv1263380073:83 , srv1536760043:83 , srv1711857449:83 , srv1726215695:83 , srv33886312:83 , srv344628893:83 , srv573090940:83 , srv841666653:83 , srv968282722:83 , srv1014606352:84 , srv103212331:84 , srv1032626936:84 , srv1041363093:84 , srv106992336:84 , srv1106052875:84 , srv1156076650:84 , srv1253052113:84 , srv142771394:84 , srv1440698048:84 , srv1501837532:84 , srv1542887536:84 , srv1683946953:84 , srv1805487706:84 , srv1810548509:84 , srv1850232880:84 , srv1861567205:84 , srv1946215734:84 , srv1965895055:84 , srv1970097582:84 , srv1983994218:84 , srv2048968593:84 , srv2082121754:84 , srv2110572916:84 , srv211585441:84 , srv388242337:84 , srv394729081:84 , srv517743729:84 , srv524235584:84 , srv560832937:84 , srv683995072:84 , srv714297180:84 , srv714948128:84 , srv870781566:84 , srv952358351:84 , srv980103922:84 , srv1088937172:85 , srv110829044:85 , srv1196135009:85 , srv1203355915:85 , srv1204749978:85 , srv129079906:85 , srv130060644:85 , srv1301811928:85 , srv1374250739:85 , srv138320111:85 , srv142129102:85 , srv142969088:85 , srv146141364:85 , srv1488298350:85 , srv1538163398:85 , srv1558758142:85 , srv1571405400:85 , srv1601122429:85 , srv1754657954:85 , srv1877827048:85 , srv1896794048:85 , srv1913406469:85 , srv2007941580:85 , srv2064930563:85 , srv2115361272:85 , srv2121104083:85 , srv2133153012:85 , srv259083556:85 , srv306799371:85 , srv388772007:85 , srv419757921:85 , srv430447900:85 , srv463096504:85 , srv50966765:85 , srv525910813:85 , srv535531963:85 , srv562510677:85 , srv596793179:85 , srv708396177:85 , srv757498382:85 , srv771634934:85 , srv827925033:85 , srv877823340:85 , srv882526581:85 , srv904444968:85 , srv921402425:85 , srv98510352:85 , srv1280769472:86 , srv1400686088:86 , srv1983102496:86 , srv2071233642:86 , srv757025169:86 , srv873569037:640 }
2023-11-10 17:55:16,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:16,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2110572916=56, srv535531963=75, srv1041363093=3, srv1970097582=48, srv1431634439=24, srv1014606352=0, srv1726215695=37, srv1983994218=50, srv1542887536=31, srv2133153012=60, srv142129102=21, srv211585441=58, srv394729081=67, srv1204749978=11, srv129079906=15, srv103212331=1, srv1301811928=17, srv50966765=71, srv1440698048=25, srv1810548509=40, srv1106052875=6, srv1805487706=39, srv757498382=86, srv683995072=81, srv525910813=74, srv1263380073=13, srv882526581=93, srv1754657954=38, srv463096504=70, srv1850232880=41, srv130060644=16, srv1400686088=20, srv980103922=98, srv1913406469=45, srv877823340=92, srv708396177=82, srv419757921=68, srv952358351=96, srv1861567205=42, srv146141364=26, srv1683946953=35, srv1374250739=18, srv2048968593=52, srv596793179=80, srv1488298350=27, srv560832937=77, srv870781566=90, srv1196135009=9, srv1965895055=47, srv388772007=66, srv827925033=88, srv841666653=89, srv430447900=69, srv714297180=83, srv2007941580=51, srv33886312=63, srv562510677=78, srv2071233642=54, srv1501837532=28, srv110829044=7, srv1032626936=2, srv1571405400=33, srv2115361272=57, srv259083556=61, srv921402425=95, srv524235584=73, srv1558758142=32, srv1538163398=30, srv142969088=23, srv1253052113=12, srv1203355915=10, srv757025169=85, srv1536760043=29, srv1896794048=44, srv2121104083=59, srv2064930563=53, srv1088937172=5, srv1946215734=46, srv1983102496=49, srv573090940=79, srv106992336=4, srv904444968=94, srv388242337=65, srv517743729=72, srv554649707=76, srv1280769472=14, srv138320111=19, srv344628893=64, srv714948128=84, srv1601122429=34, srv1156076650=8, srv873569037=91, srv98510352=99, srv2082121754=55, srv771634934=87, srv142771394=22, srv968282722=97, srv306799371=62, srv1877827048=43, srv1711857449=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:16,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:16,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:16,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:16,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:16,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 17:55:16,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 17:55:16,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 17:55:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 17:55:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 17:55:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 17:55:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 17:55:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 17:55:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 17:55:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 17:55:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 17:55:16,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:16,422 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-10 17:55:16,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.557560370423662E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-10 17:55:16,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 344 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 3.557560370423662E-5 to a new imbalance of 8.78272495078431E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:16,663 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1088937172:83 , srv1280769472:83 , srv1400686088:83 , srv1538163398:83 , srv1896794048:83 , srv1913406469:83 , srv2115361272:83 , srv2133153012:83 , srv596793179:83 , srv1014606352:84 , srv103212331:84 , srv1032626936:84 , srv106992336:84 , srv1106052875:84 , srv110829044:84 , srv1156076650:84 , srv1196135009:84 , srv1203355915:84 , srv1253052113:84 , srv1263380073:84 , srv129079906:84 , srv130060644:84 , srv1301811928:84 , srv1374250739:84 , srv138320111:84 , srv142129102:84 , srv142771394:84 , srv1431634439:84 , srv1440698048:84 , srv146141364:84 , srv1488298350:84 , srv1501837532:84 , srv1536760043:84 , srv1542887536:84 , srv1558758142:84 , srv1571405400:84 , srv1601122429:84 , srv1711857449:84 , srv1754657954:84 , srv1805487706:84 , srv1810548509:84 , srv1850232880:84 , srv1861567205:84 , srv1946215734:84 , srv1965895055:84 , srv1970097582:84 , srv1983102496:84 , srv1983994218:84 , srv2007941580:84 , srv2048968593:84 , srv2064930563:84 , srv2071233642:84 , srv2082121754:84 , srv2110572916:84 , srv211585441:84 , srv259083556:84 , srv306799371:84 , srv33886312:84 , srv344628893:84 , srv388772007:84 , srv419757921:84 , srv430447900:84 , srv463096504:84 , srv50966765:84 , srv517743729:84 , srv524235584:84 , srv525910813:84 , srv535531963:84 , srv554649707:84 , srv560832937:84 , srv562510677:84 , srv683995072:84 , srv708396177:84 , srv714297180:84 , srv714948128:84 , srv757025169:84 , srv757498382:84 , srv771634934:84 , srv827925033:84 , srv841666653:84 , srv870781566:84 , srv877823340:84 , srv882526581:84 , srv904444968:84 , srv921402425:84 , srv952358351:84 , srv968282722:84 , srv980103922:84 , srv98510352:84 , srv1041363093:85 , srv1204749978:85 , srv142969088:85 , srv1683946953:85 , srv1726215695:85 , srv1877827048:85 , srv2121104083:85 , srv388242337:85 , srv394729081:85 , srv573090940:85 , srv873569037:683 }
2023-11-10 17:55:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2110572916=56, srv535531963=75, srv1041363093=3, srv1970097582=48, srv1431634439=24, srv1014606352=0, srv1726215695=37, srv1983994218=50, srv1542887536=31, srv2133153012=60, srv142129102=21, srv211585441=58, srv394729081=67, srv1204749978=11, srv129079906=15, srv103212331=1, srv1301811928=17, srv50966765=71, srv1440698048=25, srv1810548509=40, srv1106052875=6, srv1805487706=39, srv757498382=86, srv683995072=81, srv525910813=74, srv1263380073=13, srv882526581=93, srv1754657954=38, srv463096504=70, srv1850232880=41, srv130060644=16, srv1400686088=20, srv980103922=98, srv1913406469=45, srv877823340=92, srv708396177=82, srv419757921=68, srv952358351=96, srv1861567205=42, srv146141364=26, srv1683946953=35, srv1374250739=18, srv2048968593=52, srv596793179=80, srv1488298350=27, srv560832937=77, srv870781566=90, srv1196135009=9, srv1965895055=47, srv388772007=66, srv827925033=88, srv841666653=89, srv430447900=69, srv714297180=83, srv2007941580=51, srv33886312=63, srv562510677=78, srv2071233642=54, srv1501837532=28, srv110829044=7, srv1032626936=2, srv1571405400=33, srv2115361272=57, srv259083556=61, srv921402425=95, srv524235584=73, srv1558758142=32, srv1538163398=30, srv142969088=23, srv1253052113=12, srv1203355915=10, srv757025169=85, srv1536760043=29, srv1896794048=44, srv2121104083=59, srv2064930563=53, srv1088937172=5, srv1946215734=46, srv1983102496=49, srv573090940=79, srv106992336=4, srv904444968=94, srv388242337=65, srv517743729=72, srv554649707=76, srv1280769472=14, srv138320111=19, srv344628893=64, srv714948128=84, srv1601122429=34, srv1156076650=8, srv873569037=91, srv98510352=99, srv2082121754=55, srv771634934=87, srv142771394=22, srv968282722=97, srv306799371=62, srv1877827048=43, srv1711857449=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-10 17:55:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-10 17:55:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-10 17:55:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-10 17:55:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-10 17:55:16,795 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:16,795 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1088937172:83 , srv1280769472:83 , srv1400686088:83 , srv1538163398:83 , srv1896794048:83 , srv1913406469:83 , srv2115361272:83 , srv2133153012:83 , srv596793179:83 , srv1014606352:84 , srv103212331:84 , srv1032626936:84 , srv106992336:84 , srv1106052875:84 , srv110829044:84 , srv1156076650:84 , srv1196135009:84 , srv1203355915:84 , srv1253052113:84 , srv1263380073:84 , srv129079906:84 , srv130060644:84 , srv1301811928:84 , srv1374250739:84 , srv138320111:84 , srv142129102:84 , srv142771394:84 , srv1431634439:84 , srv1440698048:84 , srv146141364:84 , srv1488298350:84 , srv1501837532:84 , srv1536760043:84 , srv1542887536:84 , srv1558758142:84 , srv1571405400:84 , srv1601122429:84 , srv1711857449:84 , srv1754657954:84 , srv1805487706:84 , srv1810548509:84 , srv1850232880:84 , srv1861567205:84 , srv1946215734:84 , srv1965895055:84 , srv1970097582:84 , srv1983102496:84 , srv1983994218:84 , srv2007941580:84 , srv2048968593:84 , srv2064930563:84 , srv2071233642:84 , srv2082121754:84 , srv2110572916:84 , srv211585441:84 , srv259083556:84 , srv306799371:84 , srv33886312:84 , srv344628893:84 , srv388772007:84 , srv419757921:84 , srv430447900:84 , srv463096504:84 , srv50966765:84 , srv517743729:84 , srv524235584:84 , srv525910813:84 , srv535531963:84 , srv554649707:84 , srv560832937:84 , srv562510677:84 , srv683995072:84 , srv708396177:84 , srv714297180:84 , srv714948128:84 , srv757025169:84 , srv757498382:84 , srv771634934:84 , srv827925033:84 , srv841666653:84 , srv870781566:84 , srv877823340:84 , srv882526581:84 , srv904444968:84 , srv921402425:84 , srv952358351:84 , srv968282722:84 , srv980103922:84 , srv98510352:84 , srv1041363093:85 , srv1204749978:85 , srv142969088:85 , srv1683946953:85 , srv1726215695:85 , srv1877827048:85 , srv2121104083:85 , srv388242337:85 , srv394729081:85 , srv573090940:85 , srv873569037:683 }
2023-11-10 17:55:16,817 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=101 (was 101), ProcessCount=168 (was 168), AvailableMemoryMB=2502 (was 2991)
2023-11-10 17:55:16,825 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=101, ProcessCount=168, AvailableMemoryMB=2502
2023-11-10 17:55:16,825 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-10 17:55:16,825 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-10 17:55:16,835 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1028854260:84 , srv1114644005:84 , srv1218779144:84 , srv1338505318:84 , srv1473419026:84 , srv1726028483:84 , srv1739277785:84 , srv174890032:84 , srv1847869510:84 , srv1871383391:84 , srv1946822414:84 , srv2010870308:84 , srv2049514202:84 , srv2088615366:84 , srv360931508:84 , srv402715293:84 , srv455646285:84 , srv525003928:84 , srv665473685:84 , srv688669833:84 , srv719614714:84 , srv752694970:84 , srv777295079:84 , srv794750586:84 , srv800409977:84 , srv830070102:84 , srv871823311:84 , srv952500174:84 , srv961241728:84 , srv87789860:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-10 17:55:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:55:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv952500174=28, srv402715293=15, srv800409977=24, srv830070102=25, srv87789860=27, srv1473419026=4, srv2088615366=13, srv174890032=7, srv1739277785=6, srv688669833=19, srv961241728=29, srv1871383391=9, srv2049514202=12, srv777295079=22, srv2010870308=11, srv1946822414=10, srv871823311=26, srv1847869510=8, srv1338505318=3, srv1726028483=5, srv360931508=14, srv719614714=20, srv794750586=23, srv665473685=18, srv752694970=21, srv1218779144=2, srv525003928=17, srv1114644005=1, srv455646285=16, srv1028854260=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:55:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:55:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:55:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:55:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:55:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:55:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:55:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:55:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-10 17:55:16,862 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1582425580749118, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:55:16,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912691660397678, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1582425580749118, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-10 17:57:16,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5852833 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912691660397678 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:57:16,859 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1028854260:90 , srv1114644005:90 , srv1218779144:90 , srv1338505318:90 , srv1473419026:90 , srv1726028483:90 , srv1739277785:90 , srv174890032:90 , srv1847869510:90 , srv1871383391:90 , srv1946822414:90 , srv2010870308:90 , srv2049514202:90 , srv2088615366:90 , srv360931508:90 , srv402715293:90 , srv455646285:90 , srv525003928:90 , srv665473685:90 , srv688669833:90 , srv719614714:90 , srv752694970:90 , srv777295079:90 , srv794750586:90 , srv800409977:90 , srv830070102:90 , srv871823311:90 , srv87789860:90 , srv952500174:90 , srv961241728:90 }
2023-11-10 17:57:16,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-10 17:57:16,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv952500174=28, srv402715293=15, srv800409977=24, srv830070102=25, srv87789860=27, srv1473419026=4, srv2088615366=13, srv174890032=7, srv1739277785=6, srv688669833=19, srv961241728=29, srv1871383391=9, srv2049514202=12, srv777295079=22, srv2010870308=11, srv1946822414=10, srv871823311=26, srv1847869510=8, srv1338505318=3, srv1726028483=5, srv360931508=14, srv719614714=20, srv794750586=23, srv665473685=18, srv752694970=21, srv1218779144=2, srv525003928=17, srv1114644005=1, srv455646285=16, srv1028854260=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-10 17:57:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-10 17:57:16,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-10 17:57:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-10 17:57:16,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-10 17:57:16,881 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1028854260:90 , srv1114644005:90 , srv1218779144:90 , srv1338505318:90 , srv1473419026:90 , srv1726028483:90 , srv1739277785:90 , srv174890032:90 , srv1847869510:90 , srv1871383391:90 , srv1946822414:90 , srv2010870308:90 , srv2049514202:90 , srv2088615366:90 , srv360931508:90 , srv402715293:90 , srv455646285:90 , srv525003928:90 , srv665473685:90 , srv688669833:90 , srv719614714:90 , srv752694970:90 , srv777295079:90 , srv794750586:90 , srv800409977:90 , srv830070102:90 , srv871823311:90 , srv87789860:90 , srv952500174:90 , srv961241728:90 }
2023-11-10 17:57:16,895 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 101) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2584 (was 2502) - AvailableMemoryMB LEAK? -