2024-03-14 14:54:41,873 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-03-14 14:54:42,163 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-03-14 14:54:42,275 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-03-14 14:54:42,340 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-14 14:54:42,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-14 14:54:42,366 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=168, AvailableMemoryMB=9273
2024-03-14 14:54:42,368 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-14 14:54:42,369 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-14 14:54:42,500 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009288799:84 , srv1074484057:84 , srv1109171897:84 , srv1109325152:84 , srv1147703501:84 , srv1161576114:84 , srv1208565192:84 , srv1229087357:84 , srv1232216721:84 , srv1239760084:84 , srv1264835001:84 , srv1298615319:84 , srv1303629514:84 , srv1335291195:84 , srv134656066:84 , srv1368712854:84 , srv1378276799:84 , srv1383305451:84 , srv1468237696:84 , srv1474884190:84 , srv1494382537:84 , srv1505129346:84 , srv1524657948:84 , srv1525990170:84 , srv1560725748:84 , srv156665825:84 , srv1572353506:84 , srv1587419781:84 , srv1620575525:84 , srv1657415967:84 , srv1683270609:84 , srv170843104:84 , srv1717982480:84 , srv1740003487:84 , srv1764939838:84 , srv1817901367:84 , srv1836851707:84 , srv187169639:84 , srv1879974905:84 , srv1904058007:84 , srv191319146:84 , srv196700972:84 , srv197384884:84 , srv2005894548:84 , srv2024363419:84 , srv2042336458:84 , srv2044761652:84 , srv2067287152:84 , srv2084678874:84 , srv2125761894:84 , srv2130713786:84 , srv213841354:84 , srv222855904:84 , srv247944687:84 , srv279842900:84 , srv291436795:84 , srv349633138:84 , srv355151193:84 , srv359133693:84 , srv367591376:84 , srv374644938:84 , srv423126872:84 , srv450256303:84 , srv454009425:84 , srv471607868:84 , srv490840524:84 , srv491105638:84 , srv491240:84 , srv497399128:84 , srv499750662:84 , srv502997010:84 , srv552639941:84 , srv573768436:84 , srv578931667:84 , srv58290343:84 , srv601445080:84 , srv622651001:84 , srv624009361:84 , srv629798763:84 , srv633160240:84 , srv646636074:84 , srv703916345:84 , srv706732452:84 , srv719218661:84 , srv762069917:84 , srv793070688:84 , srv805831700:84 , srv829772572:84 , srv894689456:84 , srv897260891:84 , srv900416199:84 , srv905022895:84 , srv907977455:84 , srv90885771:84 , srv92414502:84 , srv927572386:84 , srv966249822:84 , srv966456861:84 , srv971897454:84 , srv889687257:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-03-14 14:54:42,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:42,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv491240=67, srv1683270609=30, srv279842900=54, srv1009288799=0, srv1817901367=35, srv2024363419=44, srv1620575525=28, srv894689456=89, srv92414502=95, srv355151193=57, srv905022895=92, srv359133693=58, srv1335291195=13, srv156665825=25, srv502997010=70, srv2044761652=46, srv471607868=64, srv2130713786=50, srv2125761894=49, srv1161576114=5, srv497399128=68, srv2005894548=43, srv646636074=80, srv1303629514=12, srv450256303=62, srv629798763=78, srv1074484057=1, srv1740003487=33, srv805831700=86, srv1232216721=8, srv1368712854=15, srv349633138=56, srv1239760084=9, srv897260891=90, srv2084678874=48, srv1879974905=38, srv601445080=75, srv706732452=82, srv1109325152=3, srv58290343=74, srv624009361=77, srv1264835001=10, srv966456861=98, srv1560725748=24, srv491105638=66, srv573768436=72, srv578931667=73, srv1904058007=39, srv1494382537=20, srv1587419781=27, srv454009425=63, srv633160240=79, srv1717982480=32, srv291436795=55, srv197384884=42, srv367591376=59, srv1147703501=4, srv2042336458=45, srv1298615319=11, srv1109171897=2, srv191319146=40, srv907977455=93, srv762069917=84, srv196700972=41, srv134656066=14, srv1383305451=17, srv552639941=71, srv1657415967=29, srv900416199=91, srv703916345=81, srv1378276799=16, srv1525990170=23, srv1505129346=21, srv213841354=51, srv247944687=53, srv889687257=88, srv2067287152=47, srv170843104=31, srv1572353506=26, srv187169639=37, srv374644938=60, srv490840524=65, srv971897454=99, srv1229087357=7, srv1524657948=22, srv829772572=87, srv1836851707=36, srv90885771=94, srv1208565192=6, srv966249822=97, srv222855904=52, srv423126872=61, srv1764939838=34, srv719218661=83, srv1474884190=19, srv927572386=96, srv622651001=76, srv1468237696=18, srv499750662=69, srv793070688=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:42,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:42,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:42,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:42,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-14 14:54:42,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-14 14:54:42,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-14 14:54:42,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-14 14:54:42,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-14 14:54:42,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-14 14:54:42,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-14 14:54:42,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-14 14:54:42,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-14 14:54:42,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-14 14:54:42,776 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:42,776 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-14 14:54:42,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-14 14:54:43,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 503 ms to try 5000 different iterations.  Found a solution that moves 4696 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17746872261254953. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04176818907560744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05672308540187511, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5217777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04176818907560744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17283333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:43,159 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv279842900:80 , srv971897454:80 , srv1879974905:81 , srv1264835001:82 , srv1740003487:82 , srv1904058007:82 , srv423126872:82 , srv499750662:82 , srv907977455:82 , srv1109325152:83 , srv1378276799:83 , srv1474884190:83 , srv1560725748:83 , srv2005894548:83 , srv291436795:83 , srv805831700:83 , srv1303629514:84 , srv1383305451:84 , srv1494382537:84 , srv1717982480:84 , srv196700972:84 , srv222855904:84 , srv349633138:84 , srv374644938:84 , srv471607868:84 , srv762069917:84 , srv829772572:84 , srv966456861:84 , srv1074484057:85 , srv1147703501:85 , srv1208565192:85 , srv1335291195:85 , srv1587419781:85 , srv1683270609:85 , srv1817901367:85 , srv197384884:85 , srv2024363419:85 , srv2125761894:85 , srv2130713786:85 , srv454009425:85 , srv491105638:85 , srv497399128:85 , srv905022895:85 , srv92414502:85 , srv966249822:85 , srv1161576114:86 , srv134656066:86 , srv1764939838:86 , srv1836851707:86 , srv2042336458:86 , srv2067287152:86 , srv213841354:86 , srv578931667:86 , srv703916345:86 , srv719218661:86 , srv793070688:86 , srv897260891:86 , srv900416199:86 , srv1009288799:87 , srv1368712854:87 , srv1505129346:87 , srv1524657948:87 , srv247944687:87 , srv359133693:87 , srv491240:87 , srv601445080:87 , srv629798763:87 , srv1229087357:88 , srv1468237696:88 , srv170843104:88 , srv490840524:88 , srv58290343:88 , srv622651001:88 , srv706732452:88 , srv894689456:88 , srv1109171897:89 , srv1239760084:89 , srv156665825:89 , srv1572353506:89 , srv187169639:89 , srv502997010:89 , srv552639941:89 , srv573768436:89 , srv646636074:89 , srv927572386:89 , srv1298615319:90 , srv191319146:90 , srv2044761652:90 , srv2084678874:90 , srv450256303:90 , srv633160240:90 , srv90885771:90 , srv1232216721:91 , srv1620575525:91 , srv624009361:91 , srv1525990170:92 , srv1657415967:93 , srv355151193:93 , srv367591376:96 , srv889687257:461 }
2024-03-14 14:54:43,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:43,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv491240=67, srv1683270609=30, srv279842900=54, srv1009288799=0, srv1817901367=35, srv2024363419=44, srv1620575525=28, srv894689456=89, srv92414502=95, srv355151193=57, srv905022895=92, srv359133693=58, srv1335291195=13, srv156665825=25, srv502997010=70, srv2044761652=46, srv471607868=64, srv2130713786=50, srv2125761894=49, srv1161576114=5, srv497399128=68, srv2005894548=43, srv646636074=80, srv1303629514=12, srv450256303=62, srv629798763=78, srv1074484057=1, srv1740003487=33, srv805831700=86, srv1232216721=8, srv1368712854=15, srv349633138=56, srv1239760084=9, srv897260891=90, srv2084678874=48, srv1879974905=38, srv601445080=75, srv706732452=82, srv1109325152=3, srv58290343=74, srv624009361=77, srv1264835001=10, srv966456861=98, srv1560725748=24, srv491105638=66, srv573768436=72, srv578931667=73, srv1904058007=39, srv1494382537=20, srv1587419781=27, srv454009425=63, srv633160240=79, srv1717982480=32, srv291436795=55, srv197384884=42, srv367591376=59, srv1147703501=4, srv2042336458=45, srv1298615319=11, srv1109171897=2, srv191319146=40, srv907977455=93, srv762069917=84, srv196700972=41, srv134656066=14, srv1383305451=17, srv552639941=71, srv1657415967=29, srv900416199=91, srv703916345=81, srv1378276799=16, srv1525990170=23, srv1505129346=21, srv213841354=51, srv247944687=53, srv889687257=88, srv2067287152=47, srv170843104=31, srv1572353506=26, srv187169639=37, srv374644938=60, srv490840524=65, srv971897454=99, srv1229087357=7, srv1524657948=22, srv829772572=87, srv1836851707=36, srv90885771=94, srv1208565192=6, srv966249822=97, srv222855904=52, srv423126872=61, srv1764939838=34, srv719218661=83, srv1474884190=19, srv927572386=96, srv622651001=76, srv1468237696=18, srv499750662=69, srv793070688=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:43,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:43,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:43,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-14 14:54:43,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-14 14:54:43,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-14 14:54:43,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-14 14:54:43,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-14 14:54:43,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-14 14:54:43,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-14 14:54:43,302 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04176818907560744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05672308540187511, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04176818907560744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17283333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:43,302 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-14 14:54:43,302 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17743584051774644, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04176818907560744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05672308540187511, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04176818907560744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17283333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-14 14:54:43,593 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 391 ms to try 5000 different iterations.  Found a solution that moves 2616 regions; Going from a computed imbalance of 0.17743584051774644 to a new imbalance of 0.016269487981957324. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02176006517599153); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031979230072102884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2906666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02176006517599153); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:43,603 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv355151193:79 , srv1109171897:80 , srv1298615319:80 , srv1620575525:80 , srv367591376:80 , srv90885771:80 , srv1229087357:81 , srv1525990170:81 , srv156665825:81 , srv1657415967:81 , srv624009361:81 , srv1572353506:82 , srv187169639:82 , srv191319146:82 , srv2044761652:82 , srv2084678874:82 , srv450256303:82 , srv1468237696:83 , srv170843104:83 , srv502997010:83 , srv573768436:83 , srv633160240:83 , srv1009288799:84 , srv1208565192:84 , srv1232216721:84 , srv134656066:84 , srv1505129346:84 , srv1764939838:84 , srv197384884:84 , srv359133693:84 , srv491105638:84 , srv578931667:84 , srv58290343:84 , srv622651001:84 , srv793070688:84 , srv927572386:84 , srv1147703501:85 , srv1161576114:85 , srv1383305451:85 , srv1524657948:85 , srv2024363419:85 , srv497399128:85 , srv552639941:85 , srv646636074:85 , srv703916345:85 , srv706732452:85 , srv805831700:85 , srv900416199:85 , srv1587419781:86 , srv2042336458:86 , srv2067287152:86 , srv213841354:86 , srv247944687:86 , srv349633138:86 , srv374644938:86 , srv454009425:86 , srv491240:86 , srv719218661:86 , srv1074484057:87 , srv1239760084:87 , srv1303629514:87 , srv1335291195:87 , srv1368712854:87 , srv1817901367:87 , srv1836851707:87 , srv2125761894:87 , srv2130713786:87 , srv423126872:87 , srv966456861:87 , srv1560725748:88 , srv1683270609:88 , srv1717982480:88 , srv222855904:88 , srv471607868:88 , srv601445080:88 , srv629798763:88 , srv897260891:88 , srv1378276799:89 , srv1474884190:89 , srv1494382537:89 , srv1740003487:89 , srv499750662:89 , srv894689456:89 , srv905022895:89 , srv966249822:89 , srv291436795:90 , srv490840524:90 , srv762069917:90 , srv829772572:90 , srv92414502:90 , srv1109325152:91 , srv1264835001:91 , srv196700972:91 , srv2005894548:91 , srv907977455:91 , srv1879974905:92 , srv1904058007:92 , srv971897454:92 , srv279842900:93 , srv889687257:506 }
2024-03-14 14:54:43,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:43,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv491240=67, srv1683270609=30, srv279842900=54, srv1009288799=0, srv1817901367=35, srv2024363419=44, srv1620575525=28, srv894689456=89, srv92414502=95, srv355151193=57, srv905022895=92, srv359133693=58, srv1335291195=13, srv156665825=25, srv502997010=70, srv2044761652=46, srv471607868=64, srv2130713786=50, srv2125761894=49, srv1161576114=5, srv497399128=68, srv2005894548=43, srv646636074=80, srv1303629514=12, srv450256303=62, srv629798763=78, srv1074484057=1, srv1740003487=33, srv805831700=86, srv1232216721=8, srv1368712854=15, srv349633138=56, srv1239760084=9, srv897260891=90, srv2084678874=48, srv1879974905=38, srv601445080=75, srv706732452=82, srv1109325152=3, srv58290343=74, srv624009361=77, srv1264835001=10, srv966456861=98, srv1560725748=24, srv491105638=66, srv573768436=72, srv578931667=73, srv1904058007=39, srv1494382537=20, srv1587419781=27, srv454009425=63, srv633160240=79, srv1717982480=32, srv291436795=55, srv197384884=42, srv367591376=59, srv1147703501=4, srv2042336458=45, srv1298615319=11, srv1109171897=2, srv191319146=40, srv907977455=93, srv762069917=84, srv196700972=41, srv134656066=14, srv1383305451=17, srv552639941=71, srv1657415967=29, srv900416199=91, srv703916345=81, srv1378276799=16, srv1525990170=23, srv1505129346=21, srv213841354=51, srv247944687=53, srv889687257=88, srv2067287152=47, srv170843104=31, srv1572353506=26, srv187169639=37, srv374644938=60, srv490840524=65, srv971897454=99, srv1229087357=7, srv1524657948=22, srv829772572=87, srv1836851707=36, srv90885771=94, srv1208565192=6, srv966249822=97, srv222855904=52, srv423126872=61, srv1764939838=34, srv719218661=83, srv1474884190=19, srv927572386=96, srv622651001=76, srv1468237696=18, srv499750662=69, srv793070688=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:43,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:43,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:43,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:43,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:43,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:43,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:43,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-14 14:54:43,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-14 14:54:43,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-14 14:54:43,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-14 14:54:43,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-14 14:54:43,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-14 14:54:43,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02176006517599153); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031979230072102884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02176006517599153); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:43,746 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-14 14:54:43,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016251170358446906, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02176006517599153); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031979230072102884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02176006517599153); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01325); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-14 14:54:44,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 362 ms to try 5000 different iterations.  Found a solution that moves 990 regions; Going from a computed imbalance of 0.016251170358446906 to a new imbalance of 8.095969894581925E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007552451993465777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); MoveCostFunction : (multiplier=7.0, imbalance=0.11, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007552451993465777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:44,005 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv490840524:80 , srv894689456:80 , srv1239760084:81 , srv367591376:81 , srv629798763:81 , srv1109325152:82 , srv196700972:82 , srv92414502:82 , srv1232216721:83 , srv1657415967:83 , srv2005894548:83 , srv552639941:83 , srv601445080:83 , srv762069917:83 , srv829772572:83 , srv905022895:83 , srv927572386:83 , srv966249822:83 , srv1264835001:84 , srv1368712854:84 , srv1494382537:84 , srv1525990170:84 , srv1683270609:84 , srv1836851707:84 , srv1879974905:84 , srv1904058007:84 , srv247944687:84 , srv291436795:84 , srv573768436:84 , srv646636074:84 , srv897260891:84 , srv1074484057:85 , srv1717982480:85 , srv1817901367:85 , srv191319146:85 , srv2042336458:85 , srv2044761652:85 , srv2067287152:85 , srv2084678874:85 , srv2125761894:85 , srv2130713786:85 , srv213841354:85 , srv279842900:85 , srv450256303:85 , srv471607868:85 , srv491240:85 , srv58290343:85 , srv624009361:85 , srv633160240:85 , srv706732452:85 , srv907977455:85 , srv971897454:85 , srv1161576114:86 , srv1335291195:86 , srv1378276799:86 , srv1474884190:86 , srv1524657948:86 , srv1560725748:86 , srv1572353506:86 , srv170843104:86 , srv1740003487:86 , srv187169639:86 , srv222855904:86 , srv355151193:86 , srv374644938:86 , srv454009425:86 , srv499750662:86 , srv502997010:86 , srv622651001:86 , srv703916345:86 , srv900416199:86 , srv966456861:86 , srv1009288799:87 , srv1109171897:87 , srv1303629514:87 , srv1468237696:87 , srv156665825:87 , srv1620575525:87 , srv2024363419:87 , srv349633138:87 , srv359133693:87 , srv578931667:87 , srv719218661:87 , srv793070688:87 , srv1147703501:88 , srv1208565192:88 , srv1229087357:88 , srv1298615319:88 , srv134656066:88 , srv1383305451:88 , srv1505129346:88 , srv1587419781:88 , srv1764939838:88 , srv423126872:88 , srv491105638:88 , srv497399128:88 , srv90885771:88 , srv197384884:89 , srv805831700:89 , srv889687257:558 }
2024-03-14 14:54:44,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:44,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv491240=67, srv1683270609=30, srv279842900=54, srv1009288799=0, srv1817901367=35, srv2024363419=44, srv1620575525=28, srv894689456=89, srv92414502=95, srv355151193=57, srv905022895=92, srv359133693=58, srv1335291195=13, srv156665825=25, srv502997010=70, srv2044761652=46, srv471607868=64, srv2130713786=50, srv2125761894=49, srv1161576114=5, srv497399128=68, srv2005894548=43, srv646636074=80, srv1303629514=12, srv450256303=62, srv629798763=78, srv1074484057=1, srv1740003487=33, srv805831700=86, srv1232216721=8, srv1368712854=15, srv349633138=56, srv1239760084=9, srv897260891=90, srv2084678874=48, srv1879974905=38, srv601445080=75, srv706732452=82, srv1109325152=3, srv58290343=74, srv624009361=77, srv1264835001=10, srv966456861=98, srv1560725748=24, srv491105638=66, srv573768436=72, srv578931667=73, srv1904058007=39, srv1494382537=20, srv1587419781=27, srv454009425=63, srv633160240=79, srv1717982480=32, srv291436795=55, srv197384884=42, srv367591376=59, srv1147703501=4, srv2042336458=45, srv1298615319=11, srv1109171897=2, srv191319146=40, srv907977455=93, srv762069917=84, srv196700972=41, srv134656066=14, srv1383305451=17, srv552639941=71, srv1657415967=29, srv900416199=91, srv703916345=81, srv1378276799=16, srv1525990170=23, srv1505129346=21, srv213841354=51, srv247944687=53, srv889687257=88, srv2067287152=47, srv170843104=31, srv1572353506=26, srv187169639=37, srv374644938=60, srv490840524=65, srv971897454=99, srv1229087357=7, srv1524657948=22, srv829772572=87, srv1836851707=36, srv90885771=94, srv1208565192=6, srv966249822=97, srv222855904=52, srv423126872=61, srv1764939838=34, srv719218661=83, srv1474884190=19, srv927572386=96, srv622651001=76, srv1468237696=18, srv499750662=69, srv793070688=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:44,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:44,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:44,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:44,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-14 14:54:44,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-14 14:54:44,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-14 14:54:44,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-14 14:54:44,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-14 14:54:44,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-14 14:54:44,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-14 14:54:44,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-14 14:54:44,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-14 14:54:44,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-14 14:54:44,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-14 14:54:44,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-14 14:54:44,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-14 14:54:44,152 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007552451993465777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007552451993465777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:44,153 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-14 14:54:44,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.026648612948461E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007552451993465777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007552451993465777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-14 14:54:44,505 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 453 ms to try 5000 different iterations.  Found a solution that moves 241 regions; Going from a computed imbalance of 8.026648612948461E-4 to a new imbalance of 3.61373662400105E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.02677777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:44,506 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1147703501:83 , srv1505129346:83 , srv622651001:83 , srv646636074:83 , srv1009288799:84 , srv1232216721:84 , srv1264835001:84 , srv1298615319:84 , srv1303629514:84 , srv1335291195:84 , srv134656066:84 , srv1368712854:84 , srv1378276799:84 , srv1468237696:84 , srv1474884190:84 , srv1524657948:84 , srv1572353506:84 , srv1587419781:84 , srv1620575525:84 , srv1764939838:84 , srv1904058007:84 , srv191319146:84 , srv197384884:84 , srv2084678874:84 , srv222855904:84 , srv279842900:84 , srv291436795:84 , srv355151193:84 , srv359133693:84 , srv423126872:84 , srv490840524:84 , srv491240:84 , srv497399128:84 , srv601445080:84 , srv633160240:84 , srv719218661:84 , srv897260891:84 , srv907977455:84 , srv90885771:84 , srv1161576114:85 , srv1208565192:85 , srv1239760084:85 , srv1383305451:85 , srv1494382537:85 , srv1525990170:85 , srv1560725748:85 , srv156665825:85 , srv1657415967:85 , srv1683270609:85 , srv170843104:85 , srv1717982480:85 , srv1740003487:85 , srv1817901367:85 , srv1836851707:85 , srv1879974905:85 , srv2005894548:85 , srv2024363419:85 , srv2042336458:85 , srv2044761652:85 , srv2067287152:85 , srv2125761894:85 , srv2130713786:85 , srv213841354:85 , srv349633138:85 , srv367591376:85 , srv450256303:85 , srv454009425:85 , srv471607868:85 , srv491105638:85 , srv499750662:85 , srv502997010:85 , srv552639941:85 , srv573768436:85 , srv578931667:85 , srv58290343:85 , srv624009361:85 , srv703916345:85 , srv706732452:85 , srv762069917:85 , srv793070688:85 , srv805831700:85 , srv829772572:85 , srv894689456:85 , srv900416199:85 , srv905022895:85 , srv92414502:85 , srv966249822:85 , srv966456861:85 , srv971897454:85 , srv1074484057:86 , srv1109171897:86 , srv1109325152:86 , srv1229087357:86 , srv187169639:86 , srv196700972:86 , srv247944687:86 , srv374644938:86 , srv629798763:86 , srv927572386:86 , srv889687257:618 }
2024-03-14 14:54:44,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:44,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv491240=67, srv1683270609=30, srv279842900=54, srv1009288799=0, srv1817901367=35, srv2024363419=44, srv1620575525=28, srv894689456=89, srv92414502=95, srv355151193=57, srv905022895=92, srv359133693=58, srv1335291195=13, srv156665825=25, srv502997010=70, srv2044761652=46, srv471607868=64, srv2130713786=50, srv2125761894=49, srv1161576114=5, srv497399128=68, srv2005894548=43, srv646636074=80, srv1303629514=12, srv450256303=62, srv629798763=78, srv1074484057=1, srv1740003487=33, srv805831700=86, srv1232216721=8, srv1368712854=15, srv349633138=56, srv1239760084=9, srv897260891=90, srv2084678874=48, srv1879974905=38, srv601445080=75, srv706732452=82, srv1109325152=3, srv58290343=74, srv624009361=77, srv1264835001=10, srv966456861=98, srv1560725748=24, srv491105638=66, srv573768436=72, srv578931667=73, srv1904058007=39, srv1494382537=20, srv1587419781=27, srv454009425=63, srv633160240=79, srv1717982480=32, srv291436795=55, srv197384884=42, srv367591376=59, srv1147703501=4, srv2042336458=45, srv1298615319=11, srv1109171897=2, srv191319146=40, srv907977455=93, srv762069917=84, srv196700972=41, srv134656066=14, srv1383305451=17, srv552639941=71, srv1657415967=29, srv900416199=91, srv703916345=81, srv1378276799=16, srv1525990170=23, srv1505129346=21, srv213841354=51, srv247944687=53, srv889687257=88, srv2067287152=47, srv170843104=31, srv1572353506=26, srv187169639=37, srv374644938=60, srv490840524=65, srv971897454=99, srv1229087357=7, srv1524657948=22, srv829772572=87, srv1836851707=36, srv90885771=94, srv1208565192=6, srv966249822=97, srv222855904=52, srv423126872=61, srv1764939838=34, srv719218661=83, srv1474884190=19, srv927572386=96, srv622651001=76, srv1468237696=18, srv499750662=69, srv793070688=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:44,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:44,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:44,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:44,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:44,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:44,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-14 14:54:44,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-14 14:54:44,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-14 14:54:44,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-14 14:54:44,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-14 14:54:44,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-14 14:54:44,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-14 14:54:44,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-14 14:54:44,647 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:44,647 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-14 14:54:44,648 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.4449848171963614E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-14 14:54:44,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 339 ms to try 5000 different iterations.  Found a solution that moves 38 regions; Going from a computed imbalance of 3.4449848171963614E-5 to a new imbalance of 7.010150740909881E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.004222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:44,886 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1074484057:83 , srv1229087357:83 , srv1587419781:83 , srv187169639:83 , srv196700972:83 , srv247944687:83 , srv502997010:83 , srv706732452:83 , srv719218661:83 , srv1009288799:84 , srv1109171897:84 , srv1109325152:84 , srv1161576114:84 , srv1208565192:84 , srv1232216721:84 , srv1239760084:84 , srv1298615319:84 , srv1303629514:84 , srv1335291195:84 , srv134656066:84 , srv1368712854:84 , srv1378276799:84 , srv1383305451:84 , srv1468237696:84 , srv1474884190:84 , srv1494382537:84 , srv1505129346:84 , srv1524657948:84 , srv1525990170:84 , srv1560725748:84 , srv156665825:84 , srv1620575525:84 , srv1657415967:84 , srv1683270609:84 , srv170843104:84 , srv1717982480:84 , srv1740003487:84 , srv1764939838:84 , srv1817901367:84 , srv1836851707:84 , srv1879974905:84 , srv1904058007:84 , srv197384884:84 , srv2005894548:84 , srv2024363419:84 , srv2042336458:84 , srv2044761652:84 , srv2067287152:84 , srv2125761894:84 , srv2130713786:84 , srv213841354:84 , srv222855904:84 , srv279842900:84 , srv349633138:84 , srv355151193:84 , srv359133693:84 , srv367591376:84 , srv374644938:84 , srv450256303:84 , srv454009425:84 , srv471607868:84 , srv490840524:84 , srv491105638:84 , srv491240:84 , srv497399128:84 , srv499750662:84 , srv552639941:84 , srv578931667:84 , srv58290343:84 , srv601445080:84 , srv624009361:84 , srv629798763:84 , srv633160240:84 , srv703916345:84 , srv762069917:84 , srv793070688:84 , srv805831700:84 , srv829772572:84 , srv894689456:84 , srv897260891:84 , srv900416199:84 , srv905022895:84 , srv907977455:84 , srv90885771:84 , srv92414502:84 , srv927572386:84 , srv966249822:84 , srv966456861:84 , srv971897454:84 , srv1147703501:85 , srv1264835001:85 , srv1572353506:85 , srv191319146:85 , srv2084678874:85 , srv291436795:85 , srv423126872:85 , srv573768436:85 , srv622651001:85 , srv646636074:85 , srv889687257:683 }
2024-03-14 14:54:44,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:44,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv491240=67, srv1683270609=30, srv279842900=54, srv1009288799=0, srv1817901367=35, srv2024363419=44, srv1620575525=28, srv894689456=89, srv92414502=95, srv355151193=57, srv905022895=92, srv359133693=58, srv1335291195=13, srv156665825=25, srv502997010=70, srv2044761652=46, srv471607868=64, srv2130713786=50, srv2125761894=49, srv1161576114=5, srv497399128=68, srv2005894548=43, srv646636074=80, srv1303629514=12, srv450256303=62, srv629798763=78, srv1074484057=1, srv1740003487=33, srv805831700=86, srv1232216721=8, srv1368712854=15, srv349633138=56, srv1239760084=9, srv897260891=90, srv2084678874=48, srv1879974905=38, srv601445080=75, srv706732452=82, srv1109325152=3, srv58290343=74, srv624009361=77, srv1264835001=10, srv966456861=98, srv1560725748=24, srv491105638=66, srv573768436=72, srv578931667=73, srv1904058007=39, srv1494382537=20, srv1587419781=27, srv454009425=63, srv633160240=79, srv1717982480=32, srv291436795=55, srv197384884=42, srv367591376=59, srv1147703501=4, srv2042336458=45, srv1298615319=11, srv1109171897=2, srv191319146=40, srv907977455=93, srv762069917=84, srv196700972=41, srv134656066=14, srv1383305451=17, srv552639941=71, srv1657415967=29, srv900416199=91, srv703916345=81, srv1378276799=16, srv1525990170=23, srv1505129346=21, srv213841354=51, srv247944687=53, srv889687257=88, srv2067287152=47, srv170843104=31, srv1572353506=26, srv187169639=37, srv374644938=60, srv490840524=65, srv971897454=99, srv1229087357=7, srv1524657948=22, srv829772572=87, srv1836851707=36, srv90885771=94, srv1208565192=6, srv966249822=97, srv222855904=52, srv423126872=61, srv1764939838=34, srv719218661=83, srv1474884190=19, srv927572386=96, srv622651001=76, srv1468237696=18, srv499750662=69, srv793070688=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:44,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:44,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:44,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:44,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:44,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:44,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:44,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-14 14:54:44,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-14 14:54:44,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-14 14:54:44,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-14 14:54:44,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-14 14:54:44,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-14 14:54:44,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-14 14:54:45,019 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:45,019 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1074484057:83 , srv1229087357:83 , srv1587419781:83 , srv187169639:83 , srv196700972:83 , srv247944687:83 , srv502997010:83 , srv706732452:83 , srv719218661:83 , srv1009288799:84 , srv1109171897:84 , srv1109325152:84 , srv1161576114:84 , srv1208565192:84 , srv1232216721:84 , srv1239760084:84 , srv1298615319:84 , srv1303629514:84 , srv1335291195:84 , srv134656066:84 , srv1368712854:84 , srv1378276799:84 , srv1383305451:84 , srv1468237696:84 , srv1474884190:84 , srv1494382537:84 , srv1505129346:84 , srv1524657948:84 , srv1525990170:84 , srv1560725748:84 , srv156665825:84 , srv1620575525:84 , srv1657415967:84 , srv1683270609:84 , srv170843104:84 , srv1717982480:84 , srv1740003487:84 , srv1764939838:84 , srv1817901367:84 , srv1836851707:84 , srv1879974905:84 , srv1904058007:84 , srv197384884:84 , srv2005894548:84 , srv2024363419:84 , srv2042336458:84 , srv2044761652:84 , srv2067287152:84 , srv2125761894:84 , srv2130713786:84 , srv213841354:84 , srv222855904:84 , srv279842900:84 , srv349633138:84 , srv355151193:84 , srv359133693:84 , srv367591376:84 , srv374644938:84 , srv450256303:84 , srv454009425:84 , srv471607868:84 , srv490840524:84 , srv491105638:84 , srv491240:84 , srv497399128:84 , srv499750662:84 , srv552639941:84 , srv578931667:84 , srv58290343:84 , srv601445080:84 , srv624009361:84 , srv629798763:84 , srv633160240:84 , srv703916345:84 , srv762069917:84 , srv793070688:84 , srv805831700:84 , srv829772572:84 , srv894689456:84 , srv897260891:84 , srv900416199:84 , srv905022895:84 , srv907977455:84 , srv90885771:84 , srv92414502:84 , srv927572386:84 , srv966249822:84 , srv966456861:84 , srv971897454:84 , srv1147703501:85 , srv1264835001:85 , srv1572353506:85 , srv191319146:85 , srv2084678874:85 , srv291436795:85 , srv423126872:85 , srv573768436:85 , srv622651001:85 , srv646636074:85 , srv889687257:683 }
2024-03-14 14:54:45,048 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 213), ProcessCount=168 (was 168), AvailableMemoryMB=8771 (was 9273)
2024-03-14 14:54:45,057 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=168, AvailableMemoryMB=8771
2024-03-14 14:54:45,058 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-14 14:54:45,058 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-03-14 14:54:45,068 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1038104424:84 , srv1139857440:84 , srv1149555914:84 , srv1303000452:84 , srv1303040561:84 , srv1331008674:84 , srv1378117706:84 , srv1575024206:84 , srv1726689153:84 , srv1733306572:84 , srv1755616665:84 , srv1889056520:84 , srv19242860:84 , srv1951401796:84 , srv1961471161:84 , srv301162521:84 , srv316397815:84 , srv437843521:84 , srv494420408:84 , srv732860207:84 , srv755265821:84 , srv802946334:84 , srv901485791:84 , srv906453102:84 , srv950484227:84 , srv954612995:84 , srv960327373:84 , srv975222153:84 , srv976395093:84 , srv46461266:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-03-14 14:54:45,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:54:45,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1038104424=0, srv46461266=18, srv906453102=24, srv901485791=23, srv954612995=26, srv1575024206=7, srv1733306572=9, srv1726689153=8, srv301162521=15, srv494420408=19, srv1961471161=14, srv437843521=17, srv316397815=16, srv732860207=20, srv1303040561=4, srv1755616665=10, srv950484227=25, srv975222153=28, srv976395093=29, srv1139857440=1, srv1951401796=13, srv1303000452=3, srv960327373=27, srv1331008674=5, srv755265821=21, srv1378117706=6, srv1889056520=11, srv1149555914=2, srv802946334=22, srv19242860=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:54:45,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:54:45,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-14 14:54:45,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1254801890443553, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:54:45,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912588427242653, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1254801890443553, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-03-14 14:56:45,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5542474 different iterations.  Found a solution that moves 1854 regions; Going from a computed imbalance of 0.9912588427242653 to a new imbalance of 4.3273284898463826E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:56:45,089 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1038104424:90 , srv1139857440:90 , srv1149555914:90 , srv1303000452:90 , srv1303040561:90 , srv1331008674:90 , srv1378117706:90 , srv1575024206:90 , srv1726689153:90 , srv1733306572:90 , srv1755616665:90 , srv1889056520:90 , srv19242860:90 , srv1951401796:90 , srv1961471161:90 , srv301162521:90 , srv316397815:90 , srv437843521:90 , srv46461266:90 , srv494420408:90 , srv732860207:90 , srv755265821:90 , srv802946334:90 , srv901485791:90 , srv906453102:90 , srv950484227:90 , srv954612995:90 , srv960327373:90 , srv975222153:90 , srv976395093:90 }
2024-03-14 14:56:45,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-14 14:56:45,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1038104424=0, srv46461266=18, srv906453102=24, srv901485791=23, srv954612995=26, srv1575024206=7, srv1733306572=9, srv1726689153=8, srv301162521=15, srv494420408=19, srv1961471161=14, srv437843521=17, srv316397815=16, srv732860207=20, srv1303040561=4, srv1755616665=10, srv950484227=25, srv975222153=28, srv976395093=29, srv1139857440=1, srv1951401796=13, srv1303000452=3, srv960327373=27, srv1331008674=5, srv755265821=21, srv1378117706=6, srv1889056520=11, srv1149555914=2, srv802946334=22, srv19242860=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-14 14:56:45,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-14 14:56:45,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-14 14:56:45,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-14 14:56:45,107 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1038104424:90 , srv1139857440:90 , srv1149555914:90 , srv1303000452:90 , srv1303040561:90 , srv1331008674:90 , srv1378117706:90 , srv1575024206:90 , srv1726689153:90 , srv1733306572:90 , srv1755616665:90 , srv1889056520:90 , srv19242860:90 , srv1951401796:90 , srv1961471161:90 , srv301162521:90 , srv316397815:90 , srv437843521:90 , srv46461266:90 , srv494420408:90 , srv732860207:90 , srv755265821:90 , srv802946334:90 , srv901485791:90 , srv906453102:90 , srv950484227:90 , srv954612995:90 , srv960327373:90 , srv975222153:90 , srv976395093:90 }
2024-03-14 14:56:45,121 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 220), ProcessCount=168 (was 168), AvailableMemoryMB=8005 (was 8771)