2023-10-27 23:52:39,853 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-27 23:52:40,129 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-27 23:52:40,238 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-27 23:52:40,305 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 23:52:40,311 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-27 23:52:40,324 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=348, ProcessCount=170, AvailableMemoryMB=6958
2023-10-27 23:52:40,326 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 23:52:40,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-27 23:52:40,469 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006184478:84 , srv101487724:84 , srv1065051180:84 , srv1081538630:84 , srv1125065411:84 , srv1134788615:84 , srv1141772552:84 , srv1225634242:84 , srv1250711478:84 , srv1252051454:84 , srv1295466430:84 , srv1316620098:84 , srv1333314065:84 , srv13352053:84 , srv1347176714:84 , srv1405731613:84 , srv1408730748:84 , srv1413910916:84 , srv1468510580:84 , srv1482383936:84 , srv1485855658:84 , srv1492215450:84 , srv1512489861:84 , srv1519618197:84 , srv1530742628:84 , srv1539831790:84 , srv1595320346:84 , srv1616710650:84 , srv16167390:84 , srv1621964851:84 , srv1638154415:84 , srv1668030863:84 , srv1691642439:84 , srv1692203738:84 , srv1749852960:84 , srv1760348109:84 , srv1774256497:84 , srv1782637015:84 , srv1880350981:84 , srv1884122061:84 , srv1895666182:84 , srv1898568097:84 , srv1924263230:84 , srv1946188469:84 , srv1985176626:84 , srv1990852053:84 , srv2013847630:84 , srv2064367589:84 , srv2106372907:84 , srv2117915108:84 , srv2122106985:84 , srv2123117304:84 , srv219684904:84 , srv231774847:84 , srv235366314:84 , srv238401910:84 , srv245022037:84 , srv249459241:84 , srv251244219:84 , srv258731683:84 , srv2602330:84 , srv269593854:84 , srv273361221:84 , srv325385118:84 , srv333312424:84 , srv372173968:84 , srv37679892:84 , srv402836865:84 , srv436161524:84 , srv446597844:84 , srv447920734:84 , srv493119896:84 , srv504647155:84 , srv532397750:84 , srv55116487:84 , srv555652368:84 , srv567967335:84 , srv608421014:84 , srv618453852:84 , srv674494937:84 , srv726364712:84 , srv75466260:84 , srv765129918:84 , srv774093463:84 , srv790672805:84 , srv794550849:84 , srv806066681:84 , srv820918863:84 , srv827445344:84 , srv838080349:84 , srv855294409:84 , srv859284545:84 , srv887388648:84 , srv937648293:84 , srv943320556:84 , srv955011427:84 , srv965799776:84 , srv993209258:84 , srv996604729:84 , srv440918705:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-27 23:52:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:52:40,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1946188469=43, srv245022037=56, srv1774256497=36, srv567967335=77, srv238401910=55, srv996604729=99, srv447920734=71, srv859284545=92, srv402836865=67, srv1898568097=41, srv504647155=73, srv2064367589=47, srv820918863=88, srv1316620098=11, srv231774847=53, srv1065051180=2, srv2106372907=48, srv608421014=78, srv436161524=68, srv325385118=63, srv1006184478=0, srv1895666182=40, srv1141772552=6, srv269593854=61, srv765129918=83, srv838080349=90, srv1539831790=25, srv1749852960=34, srv1413910916=17, srv1621964851=29, srv55116487=75, srv1595320346=26, srv855294409=91, srv806066681=87, srv955011427=96, srv827445344=89, srv1347176714=14, srv1492215450=21, srv1668030863=31, srv1638154415=30, srv333312424=64, srv1691642439=32, srv2122106985=50, srv1125065411=4, srv1405731613=15, srv1519618197=23, srv1990852053=45, srv37679892=66, srv493119896=72, srv2013847630=46, srv446597844=70, srv1884122061=39, srv1616710650=27, srv1985176626=44, srv943320556=95, srv1225634242=7, srv1468510580=18, srv75466260=82, srv887388648=93, srv16167390=28, srv258731683=59, srv1880350981=38, srv794550849=86, srv1408730748=16, srv249459241=57, srv13352053=13, srv2117915108=49, srv440918705=69, srv1530742628=24, srv1924263230=42, srv372173968=65, srv1692203738=33, srv1782637015=37, srv993209258=98, srv1512489861=22, srv219684904=52, srv1482383936=19, srv790672805=85, srv1134788615=5, srv273361221=62, srv101487724=1, srv1333314065=12, srv251244219=58, srv1485855658=20, srv555652368=76, srv532397750=74, srv774093463=84, srv674494937=80, srv2123117304=51, srv2602330=60, srv1250711478=8, srv618453852=79, srv1252051454=9, srv937648293=94, srv1760348109=35, srv1295466430=10, srv1081538630=3, srv235366314=54, srv726364712=81, srv965799776=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:52:40,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:52:40,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:52:40,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:52:40,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:52:40,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:52:40,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:52:40,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:52:40,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:52:40,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:52:40,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:52:40,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:52:40,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:52:40,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:52:40,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:52:40,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:52:40,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:52:40,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:52:40,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:52:40,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 23:52:40,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 23:52:40,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 23:52:40,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 23:52:40,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 23:52:40,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 23:52:40,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 23:52:40,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 23:52:40,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 23:52:40,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 23:52:40,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 23:52:40,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 23:52:40,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 23:52:40,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 23:52:40,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 23:52:40,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 23:52:40,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 23:52:40,818 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:40,819 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 23:52:40,819 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 23:52:41,176 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 546 ms to try 5000 different iterations.  Found a solution that moves 4671 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17912353998121747. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038707449112349614, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05099459710383314, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.519, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038707449112349614, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17425, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:41,201 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2013847630:81 , srv1468510580:82 , srv1884122061:82 , srv608421014:82 , srv1512489861:83 , srv16167390:83 , srv1760348109:83 , srv235366314:83 , srv333312424:83 , srv567967335:83 , srv1668030863:84 , srv1880350981:84 , srv1924263230:84 , srv2123117304:84 , srv258731683:84 , srv2602330:84 , srv325385118:84 , srv838080349:84 , srv855294409:84 , srv955011427:84 , srv965799776:84 , srv1065051180:85 , srv1333314065:85 , srv1482383936:85 , srv1485855658:85 , srv1898568097:85 , srv2122106985:85 , srv219684904:85 , srv231774847:85 , srv493119896:85 , srv55116487:85 , srv674494937:85 , srv996604729:85 , srv1006184478:86 , srv1125065411:86 , srv1141772552:86 , srv1252051454:86 , srv1316620098:86 , srv1405731613:86 , srv1691642439:86 , srv1749852960:86 , srv1782637015:86 , srv1895666182:86 , srv1946188469:86 , srv1985176626:86 , srv1990852053:86 , srv238401910:86 , srv273361221:86 , srv402836865:86 , srv887388648:86 , srv937648293:86 , srv101487724:87 , srv1134788615:87 , srv1250711478:87 , srv1295466430:87 , srv1408730748:87 , srv1519618197:87 , srv1595320346:87 , srv1638154415:87 , srv1692203738:87 , srv269593854:87 , srv372173968:87 , srv446597844:87 , srv504647155:87 , srv618453852:87 , srv726364712:87 , srv765129918:87 , srv774093463:87 , srv794550849:87 , srv827445344:87 , srv943320556:87 , srv993209258:87 , srv1081538630:88 , srv1347176714:88 , srv1530742628:88 , srv1539831790:88 , srv1616710650:88 , srv2064367589:88 , srv2106372907:88 , srv37679892:88 , srv790672805:88 , srv13352053:89 , srv1413910916:89 , srv1621964851:89 , srv245022037:89 , srv820918863:89 , srv1774256497:90 , srv249459241:90 , srv436161524:90 , srv532397750:90 , srv1492215450:91 , srv555652368:91 , srv75466260:91 , srv859284545:91 , srv2117915108:92 , srv251244219:92 , srv447920734:92 , srv806066681:92 , srv1225634242:93 , srv440918705:434 }
2023-10-27 23:52:41,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:52:41,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1946188469=43, srv245022037=56, srv1774256497=36, srv567967335=77, srv238401910=55, srv996604729=99, srv447920734=71, srv859284545=92, srv402836865=67, srv1898568097=41, srv504647155=73, srv2064367589=47, srv820918863=88, srv1316620098=11, srv231774847=53, srv1065051180=2, srv2106372907=48, srv608421014=78, srv436161524=68, srv325385118=63, srv1006184478=0, srv1895666182=40, srv1141772552=6, srv269593854=61, srv765129918=83, srv838080349=90, srv1539831790=25, srv1749852960=34, srv1413910916=17, srv1621964851=29, srv55116487=75, srv1595320346=26, srv855294409=91, srv806066681=87, srv955011427=96, srv827445344=89, srv1347176714=14, srv1492215450=21, srv1668030863=31, srv1638154415=30, srv333312424=64, srv1691642439=32, srv2122106985=50, srv1125065411=4, srv1405731613=15, srv1519618197=23, srv1990852053=45, srv37679892=66, srv493119896=72, srv2013847630=46, srv446597844=70, srv1884122061=39, srv1616710650=27, srv1985176626=44, srv943320556=95, srv1225634242=7, srv1468510580=18, srv75466260=82, srv887388648=93, srv16167390=28, srv258731683=59, srv1880350981=38, srv794550849=86, srv1408730748=16, srv249459241=57, srv13352053=13, srv2117915108=49, srv440918705=69, srv1530742628=24, srv1924263230=42, srv372173968=65, srv1692203738=33, srv1782637015=37, srv993209258=98, srv1512489861=22, srv219684904=52, srv1482383936=19, srv790672805=85, srv1134788615=5, srv273361221=62, srv101487724=1, srv1333314065=12, srv251244219=58, srv1485855658=20, srv555652368=76, srv532397750=74, srv774093463=84, srv674494937=80, srv2123117304=51, srv2602330=60, srv1250711478=8, srv618453852=79, srv1252051454=9, srv937648293=94, srv1760348109=35, srv1295466430=10, srv1081538630=3, srv235366314=54, srv726364712=81, srv965799776=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:52:41,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:52:41,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:52:41,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 23:52:41,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 23:52:41,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 23:52:41,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 23:52:41,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 23:52:41,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 23:52:41,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 23:52:41,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 23:52:41,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 23:52:41,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 23:52:41,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 23:52:41,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 23:52:41,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 23:52:41,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038707449112349614, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05099459710383314, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038707449112349614, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17425, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:41,364 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 23:52:41,365 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17909083294015585, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038707449112349614, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05099459710383314, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038707449112349614, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17425, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 23:52:41,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 277 ms to try 5000 different iterations.  Found a solution that moves 2621 regions; Going from a computed imbalance of 0.17909083294015585 to a new imbalance of 0.014759618295960546. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022513799789134994); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03240803270200024, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2912222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022513799789134994); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:41,546 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1225634242:78 , srv75466260:79 , srv447920734:80 , srv806066681:80 , srv1347176714:81 , srv1492215450:81 , srv1774256497:81 , srv2117915108:81 , srv555652368:81 , srv859284545:81 , srv13352053:82 , srv1621964851:82 , srv2064367589:82 , srv251244219:82 , srv436161524:82 , srv1692203738:83 , srv238401910:83 , srv372173968:83 , srv37679892:83 , srv532397750:83 , srv765129918:83 , srv1081538630:84 , srv1316620098:84 , srv1405731613:84 , srv1408730748:84 , srv1413910916:84 , srv1616710650:84 , srv2106372907:84 , srv245022037:84 , srv269593854:84 , srv402836865:84 , srv446597844:84 , srv820918863:84 , srv943320556:84 , srv1006184478:85 , srv1250711478:85 , srv1252051454:85 , srv1482383936:85 , srv1539831790:85 , srv1691642439:85 , srv1782637015:85 , srv1895666182:85 , srv1985176626:85 , srv1990852053:85 , srv249459241:85 , srv273361221:85 , srv493119896:85 , srv618453852:85 , srv674494937:85 , srv774093463:85 , srv1125065411:86 , srv1141772552:86 , srv1485855658:86 , srv1519618197:86 , srv1530742628:86 , srv1638154415:86 , srv1749852960:86 , srv1898568097:86 , srv2123117304:86 , srv231774847:86 , srv55116487:86 , srv726364712:86 , srv794550849:86 , srv827445344:86 , srv838080349:86 , srv855294409:86 , srv993209258:86 , srv101487724:87 , srv1065051180:87 , srv1333314065:87 , srv16167390:87 , srv1760348109:87 , srv2122106985:87 , srv219684904:87 , srv567967335:87 , srv887388648:87 , srv937648293:87 , srv955011427:87 , srv1134788615:88 , srv1295466430:88 , srv1595320346:88 , srv1880350981:88 , srv1924263230:88 , srv258731683:88 , srv504647155:88 , srv790672805:88 , srv965799776:88 , srv1668030863:89 , srv1946188469:89 , srv996604729:89 , srv1468510580:90 , srv1512489861:90 , srv2602330:90 , srv325385118:90 , srv1884122061:91 , srv2013847630:92 , srv235366314:92 , srv333312424:92 , srv608421014:92 , srv440918705:540 }
2023-10-27 23:52:41,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:52:41,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1946188469=43, srv245022037=56, srv1774256497=36, srv567967335=77, srv238401910=55, srv996604729=99, srv447920734=71, srv859284545=92, srv402836865=67, srv1898568097=41, srv504647155=73, srv2064367589=47, srv820918863=88, srv1316620098=11, srv231774847=53, srv1065051180=2, srv2106372907=48, srv608421014=78, srv436161524=68, srv325385118=63, srv1006184478=0, srv1895666182=40, srv1141772552=6, srv269593854=61, srv765129918=83, srv838080349=90, srv1539831790=25, srv1749852960=34, srv1413910916=17, srv1621964851=29, srv55116487=75, srv1595320346=26, srv855294409=91, srv806066681=87, srv955011427=96, srv827445344=89, srv1347176714=14, srv1492215450=21, srv1668030863=31, srv1638154415=30, srv333312424=64, srv1691642439=32, srv2122106985=50, srv1125065411=4, srv1405731613=15, srv1519618197=23, srv1990852053=45, srv37679892=66, srv493119896=72, srv2013847630=46, srv446597844=70, srv1884122061=39, srv1616710650=27, srv1985176626=44, srv943320556=95, srv1225634242=7, srv1468510580=18, srv75466260=82, srv887388648=93, srv16167390=28, srv258731683=59, srv1880350981=38, srv794550849=86, srv1408730748=16, srv249459241=57, srv13352053=13, srv2117915108=49, srv440918705=69, srv1530742628=24, srv1924263230=42, srv372173968=65, srv1692203738=33, srv1782637015=37, srv993209258=98, srv1512489861=22, srv219684904=52, srv1482383936=19, srv790672805=85, srv1134788615=5, srv273361221=62, srv101487724=1, srv1333314065=12, srv251244219=58, srv1485855658=20, srv555652368=76, srv532397750=74, srv774093463=84, srv674494937=80, srv2123117304=51, srv2602330=60, srv1250711478=8, srv618453852=79, srv1252051454=9, srv937648293=94, srv1760348109=35, srv1295466430=10, srv1081538630=3, srv235366314=54, srv726364712=81, srv965799776=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:52:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:52:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 23:52:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 23:52:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 23:52:41,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 23:52:41,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 23:52:41,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 23:52:41,681 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022513799789134994); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03240803270200024, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022513799789134994); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:41,681 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 23:52:41,682 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014741265661701829, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022513799789134994); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03240803270200024, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022513799789134994); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 23:52:41,968 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 384 ms to try 5000 different iterations.  Found a solution that moves 1057 regions; Going from a computed imbalance of 0.014741265661701829 to a new imbalance of 5.194695269830738E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004655483366657976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005443310539518174); MoveCostFunction : (multiplier=7.0, imbalance=0.11744444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004655483366657976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:41,970 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv790672805:81 , srv1134788615:82 , srv249459241:82 , srv504647155:82 , srv1595320346:83 , srv1946188469:83 , srv235366314:83 , srv333312424:83 , srv996604729:83 , srv101487724:84 , srv1295466430:84 , srv1413910916:84 , srv1530742628:84 , srv1884122061:84 , srv2117915108:84 , srv245022037:84 , srv251244219:84 , srv2602330:84 , srv325385118:84 , srv608421014:84 , srv726364712:84 , srv820918863:84 , srv887388648:84 , srv937648293:84 , srv993209258:84 , srv1065051180:85 , srv1141772552:85 , srv1333314065:85 , srv1485855658:85 , srv1492215450:85 , srv1512489861:85 , srv1519618197:85 , srv1539831790:85 , srv1668030863:85 , srv1924263230:85 , srv2013847630:85 , srv219684904:85 , srv258731683:85 , srv436161524:85 , srv447920734:85 , srv532397750:85 , srv794550849:85 , srv859284545:85 , srv1081538630:86 , srv1125065411:86 , srv1250711478:86 , srv1252051454:86 , srv1468510580:86 , srv1616710650:86 , srv1621964851:86 , srv1638154415:86 , srv1691642439:86 , srv1749852960:86 , srv1774256497:86 , srv1782637015:86 , srv1880350981:86 , srv1895666182:86 , srv1898568097:86 , srv1985176626:86 , srv1990852053:86 , srv2106372907:86 , srv2122106985:86 , srv231774847:86 , srv269593854:86 , srv37679892:86 , srv446597844:86 , srv555652368:86 , srv618453852:86 , srv774093463:86 , srv827445344:86 , srv965799776:86 , srv1225634242:87 , srv1316620098:87 , srv13352053:87 , srv1405731613:87 , srv1408730748:87 , srv1482383936:87 , srv16167390:87 , srv1692203738:87 , srv1760348109:87 , srv2123117304:87 , srv273361221:87 , srv55116487:87 , srv75466260:87 , srv806066681:87 , srv943320556:87 , srv955011427:87 , srv1006184478:88 , srv2064367589:88 , srv238401910:88 , srv372173968:88 , srv402836865:88 , srv493119896:88 , srv567967335:88 , srv765129918:88 , srv838080349:88 , srv855294409:88 , srv674494937:89 , srv1347176714:90 , srv440918705:525 }
2023-10-27 23:52:41,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:52:41,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1946188469=43, srv245022037=56, srv1774256497=36, srv567967335=77, srv238401910=55, srv996604729=99, srv447920734=71, srv859284545=92, srv402836865=67, srv1898568097=41, srv504647155=73, srv2064367589=47, srv820918863=88, srv1316620098=11, srv231774847=53, srv1065051180=2, srv2106372907=48, srv608421014=78, srv436161524=68, srv325385118=63, srv1006184478=0, srv1895666182=40, srv1141772552=6, srv269593854=61, srv765129918=83, srv838080349=90, srv1539831790=25, srv1749852960=34, srv1413910916=17, srv1621964851=29, srv55116487=75, srv1595320346=26, srv855294409=91, srv806066681=87, srv955011427=96, srv827445344=89, srv1347176714=14, srv1492215450=21, srv1668030863=31, srv1638154415=30, srv333312424=64, srv1691642439=32, srv2122106985=50, srv1125065411=4, srv1405731613=15, srv1519618197=23, srv1990852053=45, srv37679892=66, srv493119896=72, srv2013847630=46, srv446597844=70, srv1884122061=39, srv1616710650=27, srv1985176626=44, srv943320556=95, srv1225634242=7, srv1468510580=18, srv75466260=82, srv887388648=93, srv16167390=28, srv258731683=59, srv1880350981=38, srv794550849=86, srv1408730748=16, srv249459241=57, srv13352053=13, srv2117915108=49, srv440918705=69, srv1530742628=24, srv1924263230=42, srv372173968=65, srv1692203738=33, srv1782637015=37, srv993209258=98, srv1512489861=22, srv219684904=52, srv1482383936=19, srv790672805=85, srv1134788615=5, srv273361221=62, srv101487724=1, srv1333314065=12, srv251244219=58, srv1485855658=20, srv555652368=76, srv532397750=74, srv774093463=84, srv674494937=80, srv2123117304=51, srv2602330=60, srv1250711478=8, srv618453852=79, srv1252051454=9, srv937648293=94, srv1760348109=35, srv1295466430=10, srv1081538630=3, srv235366314=54, srv726364712=81, srv965799776=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:52:41,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:52:41,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:52:41,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:52:41,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 23:52:41,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 23:52:41,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 23:52:41,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 23:52:41,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 23:52:41,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 23:52:41,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 23:52:41,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 23:52:41,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 23:52:42,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004655483366657976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005443310539518174); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004655483366657976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:42,100 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 23:52:42,101 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.120682547925113E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004655483366657976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005443310539518174); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004655483366657976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 23:52:42,279 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 274 ms to try 5000 different iterations.  Found a solution that moves 213 regions; Going from a computed imbalance of 5.120682547925113E-4 to a new imbalance of 1.8965131108113297E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.023666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:42,279 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv827445344:82 , srv1006184478:83 , srv1295466430:83 , srv13352053:83 , srv1347176714:83 , srv1638154415:83 , srv674494937:83 , srv806066681:83 , srv965799776:83 , srv101487724:84 , srv1081538630:84 , srv1125065411:84 , srv1225634242:84 , srv1250711478:84 , srv1252051454:84 , srv1405731613:84 , srv1408730748:84 , srv1468510580:84 , srv1512489861:84 , srv1519618197:84 , srv1539831790:84 , srv1595320346:84 , srv1616710650:84 , srv1668030863:84 , srv1749852960:84 , srv1880350981:84 , srv1946188469:84 , srv1985176626:84 , srv2013847630:84 , srv2106372907:84 , srv2117915108:84 , srv2122106985:84 , srv251244219:84 , srv2602330:84 , srv269593854:84 , srv273361221:84 , srv325385118:84 , srv333312424:84 , srv372173968:84 , srv402836865:84 , srv493119896:84 , srv532397750:84 , srv55116487:84 , srv555652368:84 , srv567967335:84 , srv618453852:84 , srv726364712:84 , srv765129918:84 , srv774093463:84 , srv794550849:84 , srv838080349:84 , srv855294409:84 , srv955011427:84 , srv1065051180:85 , srv1134788615:85 , srv1141772552:85 , srv1316620098:85 , srv1413910916:85 , srv1482383936:85 , srv1492215450:85 , srv1530742628:85 , srv16167390:85 , srv1621964851:85 , srv1691642439:85 , srv1692203738:85 , srv1760348109:85 , srv1774256497:85 , srv1782637015:85 , srv1884122061:85 , srv1895666182:85 , srv1898568097:85 , srv1924263230:85 , srv1990852053:85 , srv2064367589:85 , srv2123117304:85 , srv231774847:85 , srv235366314:85 , srv238401910:85 , srv249459241:85 , srv258731683:85 , srv436161524:85 , srv446597844:85 , srv447920734:85 , srv504647155:85 , srv608421014:85 , srv75466260:85 , srv790672805:85 , srv820918863:85 , srv859284545:85 , srv887388648:85 , srv937648293:85 , srv943320556:85 , srv993209258:85 , srv996604729:85 , srv1333314065:86 , srv1485855658:86 , srv219684904:86 , srv245022037:86 , srv37679892:86 , srv440918705:643 }
2023-10-27 23:52:42,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:52:42,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1946188469=43, srv245022037=56, srv1774256497=36, srv567967335=77, srv238401910=55, srv996604729=99, srv447920734=71, srv859284545=92, srv402836865=67, srv1898568097=41, srv504647155=73, srv2064367589=47, srv820918863=88, srv1316620098=11, srv231774847=53, srv1065051180=2, srv2106372907=48, srv608421014=78, srv436161524=68, srv325385118=63, srv1006184478=0, srv1895666182=40, srv1141772552=6, srv269593854=61, srv765129918=83, srv838080349=90, srv1539831790=25, srv1749852960=34, srv1413910916=17, srv1621964851=29, srv55116487=75, srv1595320346=26, srv855294409=91, srv806066681=87, srv955011427=96, srv827445344=89, srv1347176714=14, srv1492215450=21, srv1668030863=31, srv1638154415=30, srv333312424=64, srv1691642439=32, srv2122106985=50, srv1125065411=4, srv1405731613=15, srv1519618197=23, srv1990852053=45, srv37679892=66, srv493119896=72, srv2013847630=46, srv446597844=70, srv1884122061=39, srv1616710650=27, srv1985176626=44, srv943320556=95, srv1225634242=7, srv1468510580=18, srv75466260=82, srv887388648=93, srv16167390=28, srv258731683=59, srv1880350981=38, srv794550849=86, srv1408730748=16, srv249459241=57, srv13352053=13, srv2117915108=49, srv440918705=69, srv1530742628=24, srv1924263230=42, srv372173968=65, srv1692203738=33, srv1782637015=37, srv993209258=98, srv1512489861=22, srv219684904=52, srv1482383936=19, srv790672805=85, srv1134788615=5, srv273361221=62, srv101487724=1, srv1333314065=12, srv251244219=58, srv1485855658=20, srv555652368=76, srv532397750=74, srv774093463=84, srv674494937=80, srv2123117304=51, srv2602330=60, srv1250711478=8, srv618453852=79, srv1252051454=9, srv937648293=94, srv1760348109=35, srv1295466430=10, srv1081538630=3, srv235366314=54, srv726364712=81, srv965799776=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:52:42,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:52:42,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:52:42,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:52:42,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:52:42,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 23:52:42,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 23:52:42,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 23:52:42,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 23:52:42,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 23:52:42,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 23:52:42,377 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.747367323054488E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:42,378 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv827445344:82 , srv1006184478:83 , srv1295466430:83 , srv13352053:83 , srv1347176714:83 , srv1638154415:83 , srv674494937:83 , srv806066681:83 , srv965799776:83 , srv101487724:84 , srv1081538630:84 , srv1125065411:84 , srv1225634242:84 , srv1250711478:84 , srv1252051454:84 , srv1405731613:84 , srv1408730748:84 , srv1468510580:84 , srv1512489861:84 , srv1519618197:84 , srv1539831790:84 , srv1595320346:84 , srv1616710650:84 , srv1668030863:84 , srv1749852960:84 , srv1880350981:84 , srv1946188469:84 , srv1985176626:84 , srv2013847630:84 , srv2106372907:84 , srv2117915108:84 , srv2122106985:84 , srv251244219:84 , srv2602330:84 , srv269593854:84 , srv273361221:84 , srv325385118:84 , srv333312424:84 , srv372173968:84 , srv402836865:84 , srv493119896:84 , srv532397750:84 , srv55116487:84 , srv555652368:84 , srv567967335:84 , srv618453852:84 , srv726364712:84 , srv765129918:84 , srv774093463:84 , srv794550849:84 , srv838080349:84 , srv855294409:84 , srv955011427:84 , srv1065051180:85 , srv1134788615:85 , srv1141772552:85 , srv1316620098:85 , srv1413910916:85 , srv1482383936:85 , srv1492215450:85 , srv1530742628:85 , srv16167390:85 , srv1621964851:85 , srv1691642439:85 , srv1692203738:85 , srv1760348109:85 , srv1774256497:85 , srv1782637015:85 , srv1884122061:85 , srv1895666182:85 , srv1898568097:85 , srv1924263230:85 , srv1990852053:85 , srv2064367589:85 , srv2123117304:85 , srv231774847:85 , srv235366314:85 , srv238401910:85 , srv249459241:85 , srv258731683:85 , srv436161524:85 , srv446597844:85 , srv447920734:85 , srv504647155:85 , srv608421014:85 , srv75466260:85 , srv790672805:85 , srv820918863:85 , srv859284545:85 , srv887388648:85 , srv937648293:85 , srv943320556:85 , srv993209258:85 , srv996604729:85 , srv1333314065:86 , srv1485855658:86 , srv219684904:86 , srv245022037:86 , srv37679892:86 , srv440918705:643 }
2023-10-27 23:52:42,401 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=348 (was 348), ProcessCount=170 (was 170), AvailableMemoryMB=6256 (was 6958)
2023-10-27 23:52:42,409 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=348, ProcessCount=170, AvailableMemoryMB=6256
2023-10-27 23:52:42,410 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 23:52:42,410 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-27 23:52:42,417 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1032182973:84 , srv1054657718:84 , srv1095316301:84 , srv113113471:84 , srv1137726033:84 , srv1145445182:84 , srv1168441691:84 , srv1288234896:84 , srv1347416528:84 , srv1349242136:84 , srv1587395235:84 , srv1592442365:84 , srv1602681933:84 , srv1691038086:84 , srv1864777322:84 , srv1951359844:84 , srv1978035359:84 , srv1985896244:84 , srv1995121770:84 , srv200201724:84 , srv2003270404:84 , srv216590867:84 , srv434994381:84 , srv494577735:84 , srv786073057:84 , srv787598969:84 , srv792621342:84 , srv800465769:84 , srv99251746:84 , srv903641885:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-27 23:52:42,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:52:42,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168441691=6, srv494577735=23, srv1691038086=13, srv1602681933=12, srv1145445182=5, srv200201724=19, srv1347416528=8, srv2003270404=20, srv1592442365=11, srv434994381=22, srv1951359844=15, srv1349242136=9, srv1032182973=0, srv1288234896=7, srv216590867=21, srv787598969=25, srv792621342=26, srv113113471=3, srv1137726033=4, srv800465769=27, srv1587395235=10, srv786073057=24, srv1054657718=1, srv1095316301=2, srv903641885=28, srv1995121770=18, srv99251746=29, srv1985896244=17, srv1978035359=16, srv1864777322=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:52:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:52:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:52:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:52:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:52:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:52:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:52:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:52:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:52:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:52:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:52:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:52:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-27 23:52:42,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1108831494284603, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:52:42,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912542432447461, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1108831494284603, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-27 23:54:42,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9592127 different iterations.  Found a solution that moves 1838 regions; Going from a computed imbalance of 0.9912542432447461 to a new imbalance of 4.2899836916600065E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6807407407407408, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:54:42,436 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1032182973:90 , srv1054657718:90 , srv1095316301:90 , srv113113471:90 , srv1137726033:90 , srv1145445182:90 , srv1168441691:90 , srv1288234896:90 , srv1347416528:90 , srv1349242136:90 , srv1587395235:90 , srv1592442365:90 , srv1602681933:90 , srv1691038086:90 , srv1864777322:90 , srv1951359844:90 , srv1978035359:90 , srv1985896244:90 , srv1995121770:90 , srv200201724:90 , srv2003270404:90 , srv216590867:90 , srv434994381:90 , srv494577735:90 , srv786073057:90 , srv787598969:90 , srv792621342:90 , srv800465769:90 , srv903641885:90 , srv99251746:90 }
2023-10-27 23:54:42,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 23:54:42,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1168441691=6, srv494577735=23, srv1691038086=13, srv1602681933=12, srv1145445182=5, srv200201724=19, srv1347416528=8, srv2003270404=20, srv1592442365=11, srv434994381=22, srv1951359844=15, srv1349242136=9, srv1032182973=0, srv1288234896=7, srv216590867=21, srv787598969=25, srv792621342=26, srv113113471=3, srv1137726033=4, srv800465769=27, srv1587395235=10, srv786073057=24, srv1054657718=1, srv1095316301=2, srv903641885=28, srv1995121770=18, srv99251746=29, srv1985896244=17, srv1978035359=16, srv1864777322=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 23:54:42,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 23:54:42,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-27 23:54:42,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 23:54:42,452 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1032182973:90 , srv1054657718:90 , srv1095316301:90 , srv113113471:90 , srv1137726033:90 , srv1145445182:90 , srv1168441691:90 , srv1288234896:90 , srv1347416528:90 , srv1349242136:90 , srv1587395235:90 , srv1592442365:90 , srv1602681933:90 , srv1691038086:90 , srv1864777322:90 , srv1951359844:90 , srv1978035359:90 , srv1985896244:90 , srv1995121770:90 , srv200201724:90 , srv2003270404:90 , srv216590867:90 , srv434994381:90 , srv494577735:90 , srv786073057:90 , srv787598969:90 , srv792621342:90 , srv800465769:90 , srv903641885:90 , srv99251746:90 }
2023-10-27 23:54:42,464 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 348), ProcessCount=170 (was 170), AvailableMemoryMB=5392 (was 6256)