2024-04-22 00:53:34,392 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-22 00:53:34,687 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-22 00:53:34,788 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-22 00:53:34,857 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-22 00:53:34,865 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-22 00:53:34,880 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=6886
2024-04-22 00:53:34,882 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-22 00:53:34,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-22 00:53:35,010 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100594309:84 , srv1019888745:84 , srv1032931788:84 , srv1062224921:84 , srv1076128475:84 , srv109482653:84 , srv1105511713:84 , srv1106652663:84 , srv1112721141:84 , srv1153116560:84 , srv1171806849:84 , srv1192401345:84 , srv1199384319:84 , srv1209213935:84 , srv1209631507:84 , srv1211350286:84 , srv1226396036:84 , srv1237502530:84 , srv1245207854:84 , srv1253865862:84 , srv1275355819:84 , srv1276814188:84 , srv1289424044:84 , srv1290792037:84 , srv1291338485:84 , srv1428824442:84 , srv1434761733:84 , srv1506766934:84 , srv1508803851:84 , srv1517506842:84 , srv15246684:84 , srv1541249256:84 , srv1582418731:84 , srv1607985100:84 , srv1629770431:84 , srv1641945742:84 , srv164206918:84 , srv1684210973:84 , srv1686415107:84 , srv1703736475:84 , srv1735481565:84 , srv1737499295:84 , srv1787338164:84 , srv1814612392:84 , srv1827303491:84 , srv1867062771:84 , srv1913190495:84 , srv192736407:84 , srv1928156192:84 , srv1931091373:84 , srv1938730259:84 , srv194436609:84 , srv1954484465:84 , srv1956293938:84 , srv1971262478:84 , srv1978509039:84 , srv205062705:84 , srv2096204774:84 , srv215498739:84 , srv230772838:84 , srv240671820:84 , srv281689159:84 , srv300846856:84 , srv316437804:84 , srv351703484:84 , srv377382791:84 , srv384200438:84 , srv448631547:84 , srv450214477:84 , srv485307758:84 , srv489811817:84 , srv503390345:84 , srv515347571:84 , srv527883284:84 , srv529423570:84 , srv53232268:84 , srv547359916:84 , srv558799035:84 , srv59590480:84 , srv607972812:84 , srv630315810:84 , srv683822842:84 , srv684370440:84 , srv746697657:84 , srv760166888:84 , srv763340519:84 , srv770843943:84 , srv785016718:84 , srv795598949:84 , srv811582860:84 , srv817040579:84 , srv833454170:84 , srv838751905:84 , srv863510836:84 , srv881678380:84 , srv929292531:84 , srv935813962:84 , srv962194420:84 , srv977508170:84 , srv535310957:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-22 00:53:35,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:35,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1226396036=16, srv1290792037=23, srv503390345=71, srv448631547=67, srv1428824442=25, srv15246684=30, srv1867062771=45, srv230772838=59, srv1153116560=9, srv1971262478=54, srv529423570=74, srv489811817=70, srv164206918=36, srv863510836=94, srv100594309=0, srv515347571=72, srv1062224921=3, srv1582418731=32, srv1735481565=40, srv109482653=5, srv1913190495=46, srv1171806849=10, srv1291338485=24, srv1956293938=53, srv1787338164=42, srv1686415107=38, srv351703484=64, srv316437804=63, srv1192401345=11, srv785016718=88, srv281689159=61, srv929292531=96, srv1211350286=15, srv1209631507=14, srv838751905=93, srv1019888745=1, srv1607985100=33, srv1508803851=28, srv763340519=86, srv1827303491=44, srv1106652663=7, srv1199384319=12, srv1541249256=31, srv53232268=75, srv833454170=92, srv683822842=82, srv977508170=99, srv215498739=58, srv240671820=60, srv1032931788=2, srv1954484465=52, srv1434761733=26, srv935813962=97, srv1517506842=29, srv795598949=89, srv384200438=66, srv817040579=91, srv194436609=51, srv1814612392=43, srv1938730259=50, srv558799035=78, srv1105511713=6, srv485307758=69, srv1629770431=34, srv59590480=79, srv1276814188=21, srv1641945742=35, srv1684210973=37, srv1978509039=55, srv746697657=84, srv1275355819=20, srv205062705=56, srv535310957=76, srv1737499295=41, srv760166888=85, srv1209213935=13, srv962194420=98, srv1245207854=18, srv377382791=65, srv630315810=81, srv770843943=87, srv450214477=68, srv811582860=90, srv1076128475=4, srv881678380=95, srv192736407=47, srv2096204774=57, srv547359916=77, srv1703736475=39, srv684370440=83, srv527883284=73, srv607972812=80, srv300846856=62, srv1506766934=27, srv1253865862=19, srv1931091373=49, srv1237502530=17, srv1289424044=22, srv1928156192=48, srv1112721141=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:35,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:35,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:35,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:35,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:35,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-22 00:53:35,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-22 00:53:35,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-22 00:53:35,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-22 00:53:35,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-22 00:53:35,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-22 00:53:35,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-22 00:53:35,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-22 00:53:35,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-22 00:53:35,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-22 00:53:35,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-22 00:53:35,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-22 00:53:35,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-22 00:53:35,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-22 00:53:35,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-22 00:53:35,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-22 00:53:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-22 00:53:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-22 00:53:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-22 00:53:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-22 00:53:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-22 00:53:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-22 00:53:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-22 00:53:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-22 00:53:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-22 00:53:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-22 00:53:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-22 00:53:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-22 00:53:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-22 00:53:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-22 00:53:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-22 00:53:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-22 00:53:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-22 00:53:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-22 00:53:35,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:35,341 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-22 00:53:35,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-22 00:53:35,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 618 ms to try 5000 different iterations.  Found a solution that moves 4738 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1774195185456398. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039108407211911604, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05523950504910036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5264444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039108407211911604, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17241666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24133333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:35,766 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv300846856:80 , srv1192401345:81 , srv450214477:81 , srv53232268:81 , srv770843943:81 , srv15246684:82 , srv489811817:82 , srv962194420:82 , srv100594309:83 , srv1245207854:83 , srv1686415107:83 , srv1787338164:83 , srv1938730259:83 , srv316437804:83 , srv448631547:83 , srv607972812:83 , srv935813962:83 , srv1019888745:84 , srv1062224921:84 , srv1209213935:84 , srv1290792037:84 , srv1607985100:84 , srv1928156192:84 , srv1978509039:84 , srv230772838:84 , srv485307758:84 , srv515347571:84 , srv763340519:84 , srv1171806849:85 , srv1237502530:85 , srv1428824442:85 , srv1434761733:85 , srv1517506842:85 , srv1629770431:85 , srv1931091373:85 , srv377382791:85 , srv817040579:85 , srv1076128475:86 , srv1867062771:86 , srv2096204774:86 , srv240671820:86 , srv351703484:86 , srv529423570:86 , srv630315810:86 , srv683822842:86 , srv684370440:86 , srv760166888:86 , srv785016718:86 , srv833454170:86 , srv838751905:86 , srv1153116560:87 , srv1209631507:87 , srv1275355819:87 , srv1289424044:87 , srv1508803851:87 , srv1684210973:87 , srv1703736475:87 , srv1737499295:87 , srv1827303491:87 , srv192736407:87 , srv194436609:87 , srv215498739:87 , srv281689159:87 , srv547359916:87 , srv558799035:87 , srv59590480:87 , srv811582860:87 , srv863510836:87 , srv881678380:87 , srv1032931788:88 , srv1105511713:88 , srv1106652663:88 , srv1112721141:88 , srv1971262478:88 , srv205062705:88 , srv527883284:88 , srv746697657:88 , srv795598949:88 , srv109482653:89 , srv1199384319:89 , srv1211350286:89 , srv1226396036:89 , srv1541249256:89 , srv384200438:89 , srv503390345:89 , srv1506766934:90 , srv1735481565:90 , srv1814612392:90 , srv1913190495:90 , srv977508170:90 , srv1291338485:91 , srv1956293938:91 , srv1276814188:92 , srv1582418731:93 , srv164206918:93 , srv1954484465:94 , srv1253865862:95 , srv1641945742:95 , srv929292531:97 , srv535310957:437 }
2024-04-22 00:53:35,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:35,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1226396036=16, srv1290792037=23, srv503390345=71, srv448631547=67, srv1428824442=25, srv15246684=30, srv1867062771=45, srv230772838=59, srv1153116560=9, srv1971262478=54, srv529423570=74, srv489811817=70, srv164206918=36, srv863510836=94, srv100594309=0, srv515347571=72, srv1062224921=3, srv1582418731=32, srv1735481565=40, srv109482653=5, srv1913190495=46, srv1171806849=10, srv1291338485=24, srv1956293938=53, srv1787338164=42, srv1686415107=38, srv351703484=64, srv316437804=63, srv1192401345=11, srv785016718=88, srv281689159=61, srv929292531=96, srv1211350286=15, srv1209631507=14, srv838751905=93, srv1019888745=1, srv1607985100=33, srv1508803851=28, srv763340519=86, srv1827303491=44, srv1106652663=7, srv1199384319=12, srv1541249256=31, srv53232268=75, srv833454170=92, srv683822842=82, srv977508170=99, srv215498739=58, srv240671820=60, srv1032931788=2, srv1954484465=52, srv1434761733=26, srv935813962=97, srv1517506842=29, srv795598949=89, srv384200438=66, srv817040579=91, srv194436609=51, srv1814612392=43, srv1938730259=50, srv558799035=78, srv1105511713=6, srv485307758=69, srv1629770431=34, srv59590480=79, srv1276814188=21, srv1641945742=35, srv1684210973=37, srv1978509039=55, srv746697657=84, srv1275355819=20, srv205062705=56, srv535310957=76, srv1737499295=41, srv760166888=85, srv1209213935=13, srv962194420=98, srv1245207854=18, srv377382791=65, srv630315810=81, srv770843943=87, srv450214477=68, srv811582860=90, srv1076128475=4, srv881678380=95, srv192736407=47, srv2096204774=57, srv547359916=77, srv1703736475=39, srv684370440=83, srv527883284=73, srv607972812=80, srv300846856=62, srv1506766934=27, srv1253865862=19, srv1931091373=49, srv1237502530=17, srv1289424044=22, srv1928156192=48, srv1112721141=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:35,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:35,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:35,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:35,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:35,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-22 00:53:35,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-22 00:53:35,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-22 00:53:35,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-22 00:53:35,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-22 00:53:35,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-22 00:53:35,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-22 00:53:35,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-22 00:53:35,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-22 00:53:35,989 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039108407211911604, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05523950504910036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039108407211911604, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17241666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24133333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:35,989 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-22 00:53:35,990 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.177386342360551, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039108407211911604, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05523950504910036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039108407211911604, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17241666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24133333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-22 00:53:36,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 448 ms to try 5000 different iterations.  Found a solution that moves 2620 regions; Going from a computed imbalance of 0.177386342360551 to a new imbalance of 0.014687177190563594. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022719464926455834); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03442977856560101, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2911111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022719464926455834); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:36,283 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv929292531:76 , srv1641945742:77 , srv164206918:78 , srv1954484465:78 , srv1253865862:79 , srv1276814188:79 , srv1582418731:79 , srv1291338485:80 , srv1506766934:80 , srv1105511713:81 , srv1106652663:82 , srv1211350286:82 , srv1735481565:82 , srv503390345:82 , srv558799035:82 , srv977508170:82 , srv109482653:83 , srv1508803851:83 , srv1541249256:83 , srv1814612392:83 , srv1956293938:83 , srv384200438:83 , srv527883284:83 , srv547359916:83 , srv1032931788:84 , srv1112721141:84 , srv1199384319:84 , srv1275355819:84 , srv1913190495:84 , srv192736407:84 , srv529423570:84 , srv746697657:84 , srv795598949:84 , srv811582860:84 , srv1209631507:85 , srv1226396036:85 , srv1289424044:85 , srv1434761733:85 , srv1703736475:85 , srv1971262478:85 , srv205062705:85 , srv215498739:85 , srv240671820:85 , srv281689159:85 , srv377382791:85 , srv100594309:86 , srv1153116560:86 , srv1517506842:86 , srv1607985100:86 , srv1629770431:86 , srv1684210973:86 , srv1737499295:86 , srv1827303491:86 , srv59590480:86 , srv630315810:86 , srv683822842:86 , srv684370440:86 , srv833454170:86 , srv838751905:86 , srv881678380:86 , srv1076128475:87 , srv1237502530:87 , srv1245207854:87 , srv1428824442:87 , srv1867062771:87 , srv2096204774:87 , srv485307758:87 , srv785016718:87 , srv817040579:87 , srv1019888745:88 , srv1062224921:88 , srv1171806849:88 , srv1209213935:88 , srv1290792037:88 , srv1686415107:88 , srv1787338164:88 , srv194436609:88 , srv230772838:88 , srv351703484:88 , srv53232268:88 , srv763340519:88 , srv863510836:88 , srv962194420:88 , srv1928156192:89 , srv1938730259:89 , srv316437804:89 , srv607972812:89 , srv760166888:89 , srv15246684:90 , srv1931091373:90 , srv1978509039:90 , srv448631547:90 , srv450214477:90 , srv489811817:90 , srv515347571:90 , srv770843943:90 , srv935813962:90 , srv1192401345:91 , srv300846856:92 , srv535310957:539 }
2024-04-22 00:53:36,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:36,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1226396036=16, srv1290792037=23, srv503390345=71, srv448631547=67, srv1428824442=25, srv15246684=30, srv1867062771=45, srv230772838=59, srv1153116560=9, srv1971262478=54, srv529423570=74, srv489811817=70, srv164206918=36, srv863510836=94, srv100594309=0, srv515347571=72, srv1062224921=3, srv1582418731=32, srv1735481565=40, srv109482653=5, srv1913190495=46, srv1171806849=10, srv1291338485=24, srv1956293938=53, srv1787338164=42, srv1686415107=38, srv351703484=64, srv316437804=63, srv1192401345=11, srv785016718=88, srv281689159=61, srv929292531=96, srv1211350286=15, srv1209631507=14, srv838751905=93, srv1019888745=1, srv1607985100=33, srv1508803851=28, srv763340519=86, srv1827303491=44, srv1106652663=7, srv1199384319=12, srv1541249256=31, srv53232268=75, srv833454170=92, srv683822842=82, srv977508170=99, srv215498739=58, srv240671820=60, srv1032931788=2, srv1954484465=52, srv1434761733=26, srv935813962=97, srv1517506842=29, srv795598949=89, srv384200438=66, srv817040579=91, srv194436609=51, srv1814612392=43, srv1938730259=50, srv558799035=78, srv1105511713=6, srv485307758=69, srv1629770431=34, srv59590480=79, srv1276814188=21, srv1641945742=35, srv1684210973=37, srv1978509039=55, srv746697657=84, srv1275355819=20, srv205062705=56, srv535310957=76, srv1737499295=41, srv760166888=85, srv1209213935=13, srv962194420=98, srv1245207854=18, srv377382791=65, srv630315810=81, srv770843943=87, srv450214477=68, srv811582860=90, srv1076128475=4, srv881678380=95, srv192736407=47, srv2096204774=57, srv547359916=77, srv1703736475=39, srv684370440=83, srv527883284=73, srv607972812=80, srv300846856=62, srv1506766934=27, srv1253865862=19, srv1931091373=49, srv1237502530=17, srv1289424044=22, srv1928156192=48, srv1112721141=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:36,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:36,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:36,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:36,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:36,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:36,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:36,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:36,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-22 00:53:36,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-22 00:53:36,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-22 00:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-22 00:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-22 00:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-22 00:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-22 00:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-22 00:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-22 00:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-22 00:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-22 00:53:36,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022719464926455834); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03442977856560101, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022719464926455834); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:36,451 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-22 00:53:36,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014668831558454535, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022719464926455834); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03442977856560101, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022719464926455834); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-22 00:53:36,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 939 regions; Going from a computed imbalance of 0.014668831558454535 to a new imbalance of 8.040927528410383E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007451049886226322); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00919913136971917); MoveCostFunction : (multiplier=7.0, imbalance=0.10433333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007451049886226322); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:36,729 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1931091373:82 , srv351703484:82 , srv1226396036:83 , srv1253865862:83 , srv1913190495:83 , srv194436609:83 , srv1956293938:83 , srv760166888:83 , srv863510836:83 , srv1076128475:84 , srv1112721141:84 , srv1153116560:84 , srv1171806849:84 , srv1290792037:84 , srv1684210973:84 , srv1735481565:84 , srv1737499295:84 , srv1827303491:84 , srv1867062771:84 , srv1928156192:84 , srv1978509039:84 , srv205062705:84 , srv2096204774:84 , srv215498739:84 , srv795598949:84 , srv881678380:84 , srv929292531:84 , srv1019888745:85 , srv1032931788:85 , srv1062224921:85 , srv1199384319:85 , srv1209631507:85 , srv1428824442:85 , srv15246684:85 , srv1703736475:85 , srv1814612392:85 , srv1938730259:85 , srv1954484465:85 , srv230772838:85 , srv448631547:85 , srv489811817:85 , srv515347571:85 , srv607972812:85 , srv630315810:85 , srv683822842:85 , srv763340519:85 , srv833454170:85 , srv935813962:85 , srv109482653:86 , srv1106652663:86 , srv1192401345:86 , srv1209213935:86 , srv1211350286:86 , srv1237502530:86 , srv1245207854:86 , srv1276814188:86 , srv1289424044:86 , srv1291338485:86 , srv1434761733:86 , srv1506766934:86 , srv1517506842:86 , srv1541249256:86 , srv1582418731:86 , srv1629770431:86 , srv1641945742:86 , srv1686415107:86 , srv1787338164:86 , srv192736407:86 , srv1971262478:86 , srv240671820:86 , srv281689159:86 , srv300846856:86 , srv316437804:86 , srv384200438:86 , srv450214477:86 , srv485307758:86 , srv59590480:86 , srv684370440:86 , srv746697657:86 , srv770843943:86 , srv785016718:86 , srv817040579:86 , srv838751905:86 , srv977508170:86 , srv1275355819:87 , srv1607985100:87 , srv164206918:87 , srv377382791:87 , srv503390345:87 , srv527883284:87 , srv547359916:87 , srv811582860:87 , srv100594309:88 , srv1105511713:88 , srv1508803851:88 , srv558799035:88 , srv962194420:88 , srv529423570:89 , srv53232268:89 , srv535310957:548 }
2024-04-22 00:53:36,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:36,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1226396036=16, srv1290792037=23, srv503390345=71, srv448631547=67, srv1428824442=25, srv15246684=30, srv1867062771=45, srv230772838=59, srv1153116560=9, srv1971262478=54, srv529423570=74, srv489811817=70, srv164206918=36, srv863510836=94, srv100594309=0, srv515347571=72, srv1062224921=3, srv1582418731=32, srv1735481565=40, srv109482653=5, srv1913190495=46, srv1171806849=10, srv1291338485=24, srv1956293938=53, srv1787338164=42, srv1686415107=38, srv351703484=64, srv316437804=63, srv1192401345=11, srv785016718=88, srv281689159=61, srv929292531=96, srv1211350286=15, srv1209631507=14, srv838751905=93, srv1019888745=1, srv1607985100=33, srv1508803851=28, srv763340519=86, srv1827303491=44, srv1106652663=7, srv1199384319=12, srv1541249256=31, srv53232268=75, srv833454170=92, srv683822842=82, srv977508170=99, srv215498739=58, srv240671820=60, srv1032931788=2, srv1954484465=52, srv1434761733=26, srv935813962=97, srv1517506842=29, srv795598949=89, srv384200438=66, srv817040579=91, srv194436609=51, srv1814612392=43, srv1938730259=50, srv558799035=78, srv1105511713=6, srv485307758=69, srv1629770431=34, srv59590480=79, srv1276814188=21, srv1641945742=35, srv1684210973=37, srv1978509039=55, srv746697657=84, srv1275355819=20, srv205062705=56, srv535310957=76, srv1737499295=41, srv760166888=85, srv1209213935=13, srv962194420=98, srv1245207854=18, srv377382791=65, srv630315810=81, srv770843943=87, srv450214477=68, srv811582860=90, srv1076128475=4, srv881678380=95, srv192736407=47, srv2096204774=57, srv547359916=77, srv1703736475=39, srv684370440=83, srv527883284=73, srv607972812=80, srv300846856=62, srv1506766934=27, srv1253865862=19, srv1931091373=49, srv1237502530=17, srv1289424044=22, srv1928156192=48, srv1112721141=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:36,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:36,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:36,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:36,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:36,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:36,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:36,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:36,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:36,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:36,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-22 00:53:36,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-22 00:53:36,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-22 00:53:36,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-22 00:53:36,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-22 00:53:36,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-22 00:53:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-22 00:53:36,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-22 00:53:36,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-22 00:53:36,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-22 00:53:36,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-22 00:53:36,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-22 00:53:36,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-22 00:53:36,922 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007451049886226322); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00919913136971917); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007451049886226322); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:36,922 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-22 00:53:36,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.975177343103493E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007451049886226322); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00919913136971917); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007451049886226322); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-22 00:53:37,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 550 ms to try 5000 different iterations.  Found a solution that moves 274 regions; Going from a computed imbalance of 7.975177343103493E-4 to a new imbalance of 1.1989609158290149E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.030444444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:37,332 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1971262478:83 , srv515347571:83 , srv529423570:83 , srv53232268:83 , srv59590480:83 , srv785016718:83 , srv100594309:84 , srv1032931788:84 , srv1076128475:84 , srv109482653:84 , srv1192401345:84 , srv1199384319:84 , srv1237502530:84 , srv1275355819:84 , srv1291338485:84 , srv1508803851:84 , srv1541249256:84 , srv1582418731:84 , srv1641945742:84 , srv164206918:84 , srv1814612392:84 , srv1978509039:84 , srv281689159:84 , srv300846856:84 , srv316437804:84 , srv384200438:84 , srv448631547:84 , srv450214477:84 , srv503390345:84 , srv527883284:84 , srv558799035:84 , srv607972812:84 , srv684370440:84 , srv746697657:84 , srv760166888:84 , srv811582860:84 , srv817040579:84 , srv833454170:84 , srv838751905:84 , srv863510836:84 , srv962194420:84 , srv977508170:84 , srv1019888745:85 , srv1062224921:85 , srv1105511713:85 , srv1153116560:85 , srv1171806849:85 , srv1209213935:85 , srv1209631507:85 , srv1211350286:85 , srv1226396036:85 , srv1253865862:85 , srv1276814188:85 , srv1289424044:85 , srv1517506842:85 , srv15246684:85 , srv1607985100:85 , srv1629770431:85 , srv1684210973:85 , srv1686415107:85 , srv1703736475:85 , srv1737499295:85 , srv1787338164:85 , srv1827303491:85 , srv1913190495:85 , srv192736407:85 , srv1928156192:85 , srv1931091373:85 , srv1938730259:85 , srv194436609:85 , srv1954484465:85 , srv1956293938:85 , srv205062705:85 , srv2096204774:85 , srv230772838:85 , srv240671820:85 , srv377382791:85 , srv489811817:85 , srv547359916:85 , srv630315810:85 , srv683822842:85 , srv763340519:85 , srv770843943:85 , srv881678380:85 , srv929292531:85 , srv935813962:85 , srv1112721141:86 , srv1245207854:86 , srv1290792037:86 , srv1428824442:86 , srv1434761733:86 , srv1506766934:86 , srv1735481565:86 , srv1867062771:86 , srv351703484:86 , srv485307758:86 , srv795598949:86 , srv1106652663:87 , srv215498739:87 , srv535310957:618 }
2024-04-22 00:53:37,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:37,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1226396036=16, srv1290792037=23, srv503390345=71, srv448631547=67, srv1428824442=25, srv15246684=30, srv1867062771=45, srv230772838=59, srv1153116560=9, srv1971262478=54, srv529423570=74, srv489811817=70, srv164206918=36, srv863510836=94, srv100594309=0, srv515347571=72, srv1062224921=3, srv1582418731=32, srv1735481565=40, srv109482653=5, srv1913190495=46, srv1171806849=10, srv1291338485=24, srv1956293938=53, srv1787338164=42, srv1686415107=38, srv351703484=64, srv316437804=63, srv1192401345=11, srv785016718=88, srv281689159=61, srv929292531=96, srv1211350286=15, srv1209631507=14, srv838751905=93, srv1019888745=1, srv1607985100=33, srv1508803851=28, srv763340519=86, srv1827303491=44, srv1106652663=7, srv1199384319=12, srv1541249256=31, srv53232268=75, srv833454170=92, srv683822842=82, srv977508170=99, srv215498739=58, srv240671820=60, srv1032931788=2, srv1954484465=52, srv1434761733=26, srv935813962=97, srv1517506842=29, srv795598949=89, srv384200438=66, srv817040579=91, srv194436609=51, srv1814612392=43, srv1938730259=50, srv558799035=78, srv1105511713=6, srv485307758=69, srv1629770431=34, srv59590480=79, srv1276814188=21, srv1641945742=35, srv1684210973=37, srv1978509039=55, srv746697657=84, srv1275355819=20, srv205062705=56, srv535310957=76, srv1737499295=41, srv760166888=85, srv1209213935=13, srv962194420=98, srv1245207854=18, srv377382791=65, srv630315810=81, srv770843943=87, srv450214477=68, srv811582860=90, srv1076128475=4, srv881678380=95, srv192736407=47, srv2096204774=57, srv547359916=77, srv1703736475=39, srv684370440=83, srv527883284=73, srv607972812=80, srv300846856=62, srv1506766934=27, srv1253865862=19, srv1931091373=49, srv1237502530=17, srv1289424044=22, srv1928156192=48, srv1112721141=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:37,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:37,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-22 00:53:37,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-22 00:53:37,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-22 00:53:37,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-22 00:53:37,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-22 00:53:37,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-22 00:53:37,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:37,457 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-22 00:53:37,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=1.179775025760764E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-22 00:53:37,715 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 355 ms to try 5000 different iterations.  Found a solution that moves 43 regions; Going from a computed imbalance of 1.179775025760764E-4 to a new imbalance of 7.374331731707109E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0047777777777777775); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:37,716 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1106652663:83 , srv1209213935:83 , srv1289424044:83 , srv1428824442:83 , srv1867062771:83 , srv194436609:83 , srv215498739:83 , srv485307758:83 , srv935813962:83 , srv1019888745:84 , srv1062224921:84 , srv109482653:84 , srv1105511713:84 , srv1112721141:84 , srv1153116560:84 , srv1171806849:84 , srv1192401345:84 , srv1199384319:84 , srv1209631507:84 , srv1211350286:84 , srv1226396036:84 , srv1237502530:84 , srv1245207854:84 , srv1253865862:84 , srv1275355819:84 , srv1276814188:84 , srv1290792037:84 , srv1434761733:84 , srv1506766934:84 , srv1508803851:84 , srv1517506842:84 , srv15246684:84 , srv1541249256:84 , srv1582418731:84 , srv1607985100:84 , srv1629770431:84 , srv1641945742:84 , srv164206918:84 , srv1684210973:84 , srv1686415107:84 , srv1703736475:84 , srv1735481565:84 , srv1737499295:84 , srv1787338164:84 , srv1814612392:84 , srv1827303491:84 , srv1913190495:84 , srv192736407:84 , srv1928156192:84 , srv1931091373:84 , srv1938730259:84 , srv1954484465:84 , srv1956293938:84 , srv1971262478:84 , srv1978509039:84 , srv205062705:84 , srv2096204774:84 , srv230772838:84 , srv240671820:84 , srv281689159:84 , srv300846856:84 , srv316437804:84 , srv351703484:84 , srv377382791:84 , srv384200438:84 , srv448631547:84 , srv489811817:84 , srv503390345:84 , srv515347571:84 , srv527883284:84 , srv529423570:84 , srv547359916:84 , srv59590480:84 , srv630315810:84 , srv683822842:84 , srv684370440:84 , srv746697657:84 , srv760166888:84 , srv763340519:84 , srv770843943:84 , srv785016718:84 , srv795598949:84 , srv811582860:84 , srv817040579:84 , srv838751905:84 , srv863510836:84 , srv881678380:84 , srv929292531:84 , srv962194420:84 , srv977508170:84 , srv100594309:85 , srv1032931788:85 , srv1076128475:85 , srv1291338485:85 , srv450214477:85 , srv53232268:85 , srv558799035:85 , srv607972812:85 , srv833454170:85 , srv535310957:684 }
2024-04-22 00:53:37,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:37,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1226396036=16, srv1290792037=23, srv503390345=71, srv448631547=67, srv1428824442=25, srv15246684=30, srv1867062771=45, srv230772838=59, srv1153116560=9, srv1971262478=54, srv529423570=74, srv489811817=70, srv164206918=36, srv863510836=94, srv100594309=0, srv515347571=72, srv1062224921=3, srv1582418731=32, srv1735481565=40, srv109482653=5, srv1913190495=46, srv1171806849=10, srv1291338485=24, srv1956293938=53, srv1787338164=42, srv1686415107=38, srv351703484=64, srv316437804=63, srv1192401345=11, srv785016718=88, srv281689159=61, srv929292531=96, srv1211350286=15, srv1209631507=14, srv838751905=93, srv1019888745=1, srv1607985100=33, srv1508803851=28, srv763340519=86, srv1827303491=44, srv1106652663=7, srv1199384319=12, srv1541249256=31, srv53232268=75, srv833454170=92, srv683822842=82, srv977508170=99, srv215498739=58, srv240671820=60, srv1032931788=2, srv1954484465=52, srv1434761733=26, srv935813962=97, srv1517506842=29, srv795598949=89, srv384200438=66, srv817040579=91, srv194436609=51, srv1814612392=43, srv1938730259=50, srv558799035=78, srv1105511713=6, srv485307758=69, srv1629770431=34, srv59590480=79, srv1276814188=21, srv1641945742=35, srv1684210973=37, srv1978509039=55, srv746697657=84, srv1275355819=20, srv205062705=56, srv535310957=76, srv1737499295=41, srv760166888=85, srv1209213935=13, srv962194420=98, srv1245207854=18, srv377382791=65, srv630315810=81, srv770843943=87, srv450214477=68, srv811582860=90, srv1076128475=4, srv881678380=95, srv192736407=47, srv2096204774=57, srv547359916=77, srv1703736475=39, srv684370440=83, srv527883284=73, srv607972812=80, srv300846856=62, srv1506766934=27, srv1253865862=19, srv1931091373=49, srv1237502530=17, srv1289424044=22, srv1928156192=48, srv1112721141=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:37,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:37,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-22 00:53:37,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-22 00:53:37,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-22 00:53:37,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-22 00:53:37,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-22 00:53:37,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-22 00:53:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-22 00:53:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-22 00:53:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-22 00:53:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-22 00:53:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-22 00:53:37,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-22 00:53:37,903 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:37,904 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1106652663:83 , srv1209213935:83 , srv1289424044:83 , srv1428824442:83 , srv1867062771:83 , srv194436609:83 , srv215498739:83 , srv485307758:83 , srv935813962:83 , srv1019888745:84 , srv1062224921:84 , srv109482653:84 , srv1105511713:84 , srv1112721141:84 , srv1153116560:84 , srv1171806849:84 , srv1192401345:84 , srv1199384319:84 , srv1209631507:84 , srv1211350286:84 , srv1226396036:84 , srv1237502530:84 , srv1245207854:84 , srv1253865862:84 , srv1275355819:84 , srv1276814188:84 , srv1290792037:84 , srv1434761733:84 , srv1506766934:84 , srv1508803851:84 , srv1517506842:84 , srv15246684:84 , srv1541249256:84 , srv1582418731:84 , srv1607985100:84 , srv1629770431:84 , srv1641945742:84 , srv164206918:84 , srv1684210973:84 , srv1686415107:84 , srv1703736475:84 , srv1735481565:84 , srv1737499295:84 , srv1787338164:84 , srv1814612392:84 , srv1827303491:84 , srv1913190495:84 , srv192736407:84 , srv1928156192:84 , srv1931091373:84 , srv1938730259:84 , srv1954484465:84 , srv1956293938:84 , srv1971262478:84 , srv1978509039:84 , srv205062705:84 , srv2096204774:84 , srv230772838:84 , srv240671820:84 , srv281689159:84 , srv300846856:84 , srv316437804:84 , srv351703484:84 , srv377382791:84 , srv384200438:84 , srv448631547:84 , srv489811817:84 , srv503390345:84 , srv515347571:84 , srv527883284:84 , srv529423570:84 , srv547359916:84 , srv59590480:84 , srv630315810:84 , srv683822842:84 , srv684370440:84 , srv746697657:84 , srv760166888:84 , srv763340519:84 , srv770843943:84 , srv785016718:84 , srv795598949:84 , srv811582860:84 , srv817040579:84 , srv838751905:84 , srv863510836:84 , srv881678380:84 , srv929292531:84 , srv962194420:84 , srv977508170:84 , srv100594309:85 , srv1032931788:85 , srv1076128475:85 , srv1291338485:85 , srv450214477:85 , srv53232268:85 , srv558799035:85 , srv607972812:85 , srv833454170:85 , srv535310957:684 }
2024-04-22 00:53:37,940 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 303), ProcessCount=170 (was 170), AvailableMemoryMB=6369 (was 6886)
2024-04-22 00:53:37,961 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=6368
2024-04-22 00:53:37,962 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-22 00:53:37,963 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-22 00:53:37,973 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1087108034:84 , srv1100297039:84 , srv1139444340:84 , srv1271855365:84 , srv127460866:84 , srv1310187825:84 , srv136358548:84 , srv1395805972:84 , srv1718059242:84 , srv1751446804:84 , srv1757503617:84 , srv1775438217:84 , srv1794699464:84 , srv1817403435:84 , srv1892148450:84 , srv1979976984:84 , srv200678897:84 , srv2029833688:84 , srv2093398669:84 , srv306933874:84 , srv39429230:84 , srv404656352:84 , srv54555180:84 , srv585931653:84 , srv801650045:84 , srv823615:84 , srv964987515:84 , srv979638797:84 , srv99584840:84 , srv1939883396:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-22 00:53:37,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:53:37,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1395805972=7, srv1757503617=10, srv1939883396=15, srv801650045=25, srv1775438217=11, srv1087108034=0, srv2029833688=18, srv54555180=23, srv1271855365=3, srv1310187825=5, srv1100297039=1, srv1139444340=2, srv2093398669=19, srv39429230=21, srv1892148450=14, srv1718059242=8, srv1979976984=16, srv306933874=20, srv136358548=6, srv979638797=28, srv404656352=22, srv1817403435=13, srv823615=26, srv964987515=27, srv585931653=24, srv1751446804=9, srv99584840=29, srv1794699464=12, srv127460866=4, srv200678897=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:53:37,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-22 00:53:38,014 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.159948148080624, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:53:38,015 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912697034656093, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.159948148080624, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-22 00:55:37,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5717709 different iterations.  Found a solution that moves 1862 regions; Going from a computed imbalance of 0.9912697034656093 to a new imbalance of 4.346000888939571E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6896296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:55:38,001 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1087108034:90 , srv1100297039:90 , srv1139444340:90 , srv1271855365:90 , srv127460866:90 , srv1310187825:90 , srv136358548:90 , srv1395805972:90 , srv1718059242:90 , srv1751446804:90 , srv1757503617:90 , srv1775438217:90 , srv1794699464:90 , srv1817403435:90 , srv1892148450:90 , srv1939883396:90 , srv1979976984:90 , srv200678897:90 , srv2029833688:90 , srv2093398669:90 , srv306933874:90 , srv39429230:90 , srv404656352:90 , srv54555180:90 , srv585931653:90 , srv801650045:90 , srv823615:90 , srv964987515:90 , srv979638797:90 , srv99584840:90 }
2024-04-22 00:55:38,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-22 00:55:38,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1395805972=7, srv1757503617=10, srv1939883396=15, srv801650045=25, srv1775438217=11, srv1087108034=0, srv2029833688=18, srv54555180=23, srv1271855365=3, srv1310187825=5, srv1100297039=1, srv1139444340=2, srv2093398669=19, srv39429230=21, srv1892148450=14, srv1718059242=8, srv1979976984=16, srv306933874=20, srv136358548=6, srv979638797=28, srv404656352=22, srv1817403435=13, srv823615=26, srv964987515=27, srv585931653=24, srv1751446804=9, srv99584840=29, srv1794699464=12, srv127460866=4, srv200678897=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-22 00:55:38,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-22 00:55:38,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-22 00:55:38,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-22 00:55:38,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-22 00:55:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-22 00:55:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-22 00:55:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-22 00:55:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-22 00:55:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-22 00:55:38,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-22 00:55:38,029 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1087108034:90 , srv1100297039:90 , srv1139444340:90 , srv1271855365:90 , srv127460866:90 , srv1310187825:90 , srv136358548:90 , srv1395805972:90 , srv1718059242:90 , srv1751446804:90 , srv1757503617:90 , srv1775438217:90 , srv1794699464:90 , srv1817403435:90 , srv1892148450:90 , srv1939883396:90 , srv1979976984:90 , srv200678897:90 , srv2029833688:90 , srv2093398669:90 , srv306933874:90 , srv39429230:90 , srv404656352:90 , srv54555180:90 , srv585931653:90 , srv801650045:90 , srv823615:90 , srv964987515:90 , srv979638797:90 , srv99584840:90 }
2024-04-22 00:55:38,052 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 303), ProcessCount=167 (was 170), AvailableMemoryMB=6394 (was 6368) - AvailableMemoryMB LEAK? -