2023-04-23 12:55:41,704 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-23 12:55:42,094 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-23 12:55:42,223 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-23 12:55:42,293 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-23 12:55:42,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-23 12:55:42,314 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=388, ProcessCount=169, AvailableMemoryMB=13013
2023-04-23 12:55:42,316 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-23 12:55:42,317 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-23 12:55:42,502 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009258831:84 , srv1014440526:84 , srv1025761541:84 , srv1028665229:84 , srv1035442406:84 , srv1048142832:84 , srv105213989:84 , srv1084078970:84 , srv1096694942:84 , srv1098439663:84 , srv1101324612:84 , srv1122859885:84 , srv1124922983:84 , srv1134001749:84 , srv1144407479:84 , srv1148118489:84 , srv117042590:84 , srv1176641050:84 , srv1185497570:84 , srv1209479755:84 , srv1233676405:84 , srv1235558488:84 , srv1236818461:84 , srv1238867818:84 , srv1242414677:84 , srv1244815475:84 , srv1293935045:84 , srv1334334323:84 , srv1336173377:84 , srv1373065107:84 , srv139603495:84 , srv1421373818:84 , srv1428082445:84 , srv1440132445:84 , srv1464129917:84 , srv1473722954:84 , srv1476191141:84 , srv1489026906:84 , srv1493122318:84 , srv1509498504:84 , srv1539410542:84 , srv1569370581:84 , srv1601495179:84 , srv1603750347:84 , srv163103577:84 , srv1643988896:84 , srv165748267:84 , srv1673764858:84 , srv1681302037:84 , srv1750039480:84 , srv1758618614:84 , srv1777687299:84 , srv1800414454:84 , srv1822254922:84 , srv1830074082:84 , srv184253854:84 , srv1862536993:84 , srv1890648451:84 , srv190180659:84 , srv1945533827:84 , srv1980205785:84 , srv1985496002:84 , srv2075163973:84 , srv2090442297:84 , srv2106123483:84 , srv21104328:84 , srv2118491155:84 , srv2123638079:84 , srv269247190:84 , srv312122360:84 , srv327744709:84 , srv340723187:84 , srv342789238:84 , srv410935951:84 , srv443024242:84 , srv475716841:84 , srv475998199:84 , srv506296211:84 , srv512043004:84 , srv526042328:84 , srv530442000:84 , srv596909172:84 , srv626223833:84 , srv693451743:84 , srv753961790:84 , srv813520510:84 , srv814839710:84 , srv818196341:84 , srv835949495:84 , srv874037714:84 , srv884178853:84 , srv917141302:84 , srv917841588:84 , srv925262666:84 , srv929812220:84 , srv935681192:84 , srv963408193:84 , srv968504442:84 , srv991286236:84 , srv1649559484:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-23 12:55:42,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:42,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1601495179=42, srv475716841=76, srv1014440526=1, srv1603750347=43, srv443024242=75, srv1235558488=21, srv1084078970=7, srv917841588=93, srv1101324612=10, srv1800414454=53, srv835949495=89, srv1750039480=50, srv163103577=44, srv1489026906=37, srv1176641050=17, srv1242414677=24, srv512043004=79, srv1236818461=22, srv1945533827=60, srv506296211=78, srv1985496002=62, srv1649559484=46, srv1124922983=12, srv1048142832=5, srv1028665229=3, srv1822254922=54, srv1144407479=14, srv1890648451=58, srv342789238=73, srv117042590=16, srv1122859885=11, srv1681302037=49, srv2118491155=67, srv596909172=82, srv1238867818=23, srv1777687299=52, srv1464129917=34, srv340723187=72, srv935681192=96, srv190180659=59, srv139603495=30, srv184253854=56, srv1493122318=38, srv2075163973=63, srv693451743=84, srv813520510=86, srv929812220=95, srv1509498504=39, srv312122360=70, srv1421373818=31, srv410935951=74, srv1569370581=41, srv475998199=77, srv1025761541=2, srv626223833=83, srv1758618614=51, srv1830074082=55, srv105213989=6, srv1293935045=26, srv1373065107=29, srv530442000=81, srv753961790=85, srv1980205785=61, srv1476191141=36, srv165748267=47, srv1098439663=9, srv1244815475=25, srv2090442297=64, srv327744709=71, srv874037714=90, srv2106123483=65, srv925262666=94, srv1428082445=32, srv1673764858=48, srv2123638079=68, srv968504442=98, srv1643988896=45, srv269247190=69, srv1185497570=18, srv1539410542=40, srv526042328=80, srv1209479755=19, srv917141302=92, srv1009258831=0, srv1336173377=28, srv884178853=91, srv1096694942=8, srv1862536993=57, srv818196341=88, srv1134001749=13, srv991286236=99, srv814839710=87, srv1233676405=20, srv1148118489=15, srv1440132445=33, srv21104328=66, srv1334334323=27, srv1035442406=4, srv963408193=97, srv1473722954=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 12:55:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 12:55:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 12:55:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 12:55:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 12:55:42,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 12:55:42,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 12:55:42,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 12:55:42,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 12:55:42,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 12:55:42,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 12:55:42,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 12:55:42,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 12:55:42,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 12:55:42,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 12:55:42,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 12:55:42,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 12:55:42,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 12:55:42,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 12:55:42,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 12:55:42,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 12:55:42,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 12:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 12:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 12:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 12:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 12:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 12:55:42,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 12:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 12:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 12:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 12:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 12:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 12:55:42,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 12:55:42,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 12:55:43,053 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:43,053 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 12:55:43,054 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 12:55:43,468 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 776 ms to try 5000 different iterations.  Found a solution that moves 4732 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1747338812708808. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038943524231392336, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05880020003478041, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5257777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038943524231392336, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:43,512 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1209479755:82 , srv693451743:82 , srv917841588:82 , srv1028665229:83 , srv1084078970:83 , srv1440132445:83 , srv1539410542:83 , srv163103577:83 , srv1777687299:83 , srv184253854:83 , srv1980205785:83 , srv814839710:83 , srv874037714:83 , srv917141302:83 , srv1014440526:84 , srv1048142832:84 , srv1336173377:84 , srv1493122318:84 , srv1569370581:84 , srv1603750347:84 , srv1673764858:84 , srv21104328:84 , srv269247190:84 , srv342789238:84 , srv443024242:84 , srv512043004:84 , srv530442000:84 , srv1035442406:85 , srv1122859885:85 , srv1124922983:85 , srv1134001749:85 , srv1293935045:85 , srv1334334323:85 , srv1601495179:85 , srv1890648451:85 , srv835949495:85 , srv925262666:85 , srv117042590:86 , srv1235558488:86 , srv139603495:86 , srv1473722954:86 , srv1509498504:86 , srv1643988896:86 , srv1750039480:86 , srv1945533827:86 , srv1985496002:86 , srv2075163973:86 , srv2106123483:86 , srv2123638079:86 , srv340723187:86 , srv410935951:86 , srv626223833:86 , srv753961790:86 , srv963408193:86 , srv1101324612:87 , srv1238867818:87 , srv1476191141:87 , srv165748267:87 , srv1800414454:87 , srv1822254922:87 , srv1862536993:87 , srv2090442297:87 , srv596909172:87 , srv884178853:87 , srv929812220:87 , srv991286236:87 , srv1098439663:88 , srv1233676405:88 , srv1242414677:88 , srv1489026906:88 , srv1758618614:88 , srv475998199:88 , srv935681192:88 , srv968504442:88 , srv1009258831:89 , srv1025761541:89 , srv1144407479:89 , srv1148118489:89 , srv1185497570:89 , srv1681302037:89 , srv1830074082:89 , srv190180659:89 , srv327744709:89 , srv506296211:89 , srv526042328:89 , srv818196341:89 , srv1236818461:90 , srv2118491155:90 , srv105213989:91 , srv1096694942:91 , srv1176641050:91 , srv1244815475:91 , srv1421373818:91 , srv1428082445:91 , srv1464129917:91 , srv312122360:91 , srv813520510:91 , srv1373065107:93 , srv475716841:93 , srv1649559484:436 }
2023-04-23 12:55:43,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:43,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1601495179=42, srv475716841=76, srv1014440526=1, srv1603750347=43, srv443024242=75, srv1235558488=21, srv1084078970=7, srv917841588=93, srv1101324612=10, srv1800414454=53, srv835949495=89, srv1750039480=50, srv163103577=44, srv1489026906=37, srv1176641050=17, srv1242414677=24, srv512043004=79, srv1236818461=22, srv1945533827=60, srv506296211=78, srv1985496002=62, srv1649559484=46, srv1124922983=12, srv1048142832=5, srv1028665229=3, srv1822254922=54, srv1144407479=14, srv1890648451=58, srv342789238=73, srv117042590=16, srv1122859885=11, srv1681302037=49, srv2118491155=67, srv596909172=82, srv1238867818=23, srv1777687299=52, srv1464129917=34, srv340723187=72, srv935681192=96, srv190180659=59, srv139603495=30, srv184253854=56, srv1493122318=38, srv2075163973=63, srv693451743=84, srv813520510=86, srv929812220=95, srv1509498504=39, srv312122360=70, srv1421373818=31, srv410935951=74, srv1569370581=41, srv475998199=77, srv1025761541=2, srv626223833=83, srv1758618614=51, srv1830074082=55, srv105213989=6, srv1293935045=26, srv1373065107=29, srv530442000=81, srv753961790=85, srv1980205785=61, srv1476191141=36, srv165748267=47, srv1098439663=9, srv1244815475=25, srv2090442297=64, srv327744709=71, srv874037714=90, srv2106123483=65, srv925262666=94, srv1428082445=32, srv1673764858=48, srv2123638079=68, srv968504442=98, srv1643988896=45, srv269247190=69, srv1185497570=18, srv1539410542=40, srv526042328=80, srv1209479755=19, srv917141302=92, srv1009258831=0, srv1336173377=28, srv884178853=91, srv1096694942=8, srv1862536993=57, srv818196341=88, srv1134001749=13, srv991286236=99, srv814839710=87, srv1233676405=20, srv1148118489=15, srv1440132445=33, srv21104328=66, srv1334334323=27, srv1035442406=4, srv963408193=97, srv1473722954=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:43,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:43,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:43,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:43,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:43,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:43,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:43,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:43,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:43,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:43,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:43,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:43,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:43,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:43,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:43,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:43,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 12:55:43,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 12:55:43,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 12:55:43,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 12:55:43,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 12:55:43,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 12:55:43,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 12:55:43,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 12:55:43,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 12:55:43,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 12:55:43,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 12:55:43,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 12:55:43,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 12:55:43,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 12:55:43,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 12:55:43,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038943524231392336, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05880020003478041, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038943524231392336, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:43,757 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 12:55:43,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17470074709868993, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038943524231392336, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05880020003478041, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038943524231392336, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 12:55:44,245 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 639 ms to try 5000 different iterations.  Found a solution that moves 2643 regions; Going from a computed imbalance of 0.17470074709868993 to a new imbalance of 0.014789930107178152. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022849726229796613); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033748259297505585, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2936666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022849726229796613); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:44,263 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1373065107:78 , srv1428082445:80 , srv1464129917:80 , srv475716841:80 , srv813520510:80 , srv1176641050:81 , srv1238867818:81 , srv1244815475:81 , srv1830074082:81 , srv2118491155:81 , srv312122360:81 , srv1009258831:82 , srv1025761541:82 , srv1098439663:82 , srv1144407479:82 , srv1242414677:82 , srv1421373818:82 , srv327744709:82 , srv935681192:82 , srv105213989:83 , srv1233676405:83 , srv1236818461:83 , srv139603495:83 , srv165748267:83 , srv190180659:83 , srv1096694942:84 , srv1148118489:84 , srv1185497570:84 , srv1334334323:84 , srv1489026906:84 , srv1758618614:84 , srv2090442297:84 , srv2106123483:84 , srv506296211:84 , srv626223833:84 , srv884178853:84 , srv963408193:84 , srv1336173377:85 , srv1476191141:85 , srv1681302037:85 , srv1862536993:85 , srv526042328:85 , srv596909172:85 , srv818196341:85 , srv929812220:85 , srv1035442406:86 , srv1101324612:86 , srv117042590:86 , srv1601495179:86 , srv1603750347:86 , srv1643988896:86 , srv1945533827:86 , srv21104328:86 , srv340723187:86 , srv342789238:86 , srv925262666:86 , srv968504442:86 , srv991286236:86 , srv1122859885:87 , srv1134001749:87 , srv1235558488:87 , srv1473722954:87 , srv1493122318:87 , srv1509498504:87 , srv1539410542:87 , srv1569370581:87 , srv1750039480:87 , srv1777687299:87 , srv1985496002:87 , srv2075163973:87 , srv269247190:87 , srv410935951:87 , srv475998199:87 , srv512043004:87 , srv753961790:87 , srv917141302:87 , srv1014440526:88 , srv1124922983:88 , srv1293935045:88 , srv1440132445:88 , srv163103577:88 , srv184253854:88 , srv1890648451:88 , srv874037714:88 , srv1673764858:89 , srv1800414454:89 , srv1822254922:89 , srv2123638079:89 , srv443024242:89 , srv1028665229:90 , srv1048142832:90 , srv1084078970:90 , srv1209479755:90 , srv1980205785:90 , srv530442000:90 , srv693451743:90 , srv814839710:90 , srv835949495:90 , srv917841588:90 , srv1649559484:541 }
2023-04-23 12:55:44,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:44,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1601495179=42, srv475716841=76, srv1014440526=1, srv1603750347=43, srv443024242=75, srv1235558488=21, srv1084078970=7, srv917841588=93, srv1101324612=10, srv1800414454=53, srv835949495=89, srv1750039480=50, srv163103577=44, srv1489026906=37, srv1176641050=17, srv1242414677=24, srv512043004=79, srv1236818461=22, srv1945533827=60, srv506296211=78, srv1985496002=62, srv1649559484=46, srv1124922983=12, srv1048142832=5, srv1028665229=3, srv1822254922=54, srv1144407479=14, srv1890648451=58, srv342789238=73, srv117042590=16, srv1122859885=11, srv1681302037=49, srv2118491155=67, srv596909172=82, srv1238867818=23, srv1777687299=52, srv1464129917=34, srv340723187=72, srv935681192=96, srv190180659=59, srv139603495=30, srv184253854=56, srv1493122318=38, srv2075163973=63, srv693451743=84, srv813520510=86, srv929812220=95, srv1509498504=39, srv312122360=70, srv1421373818=31, srv410935951=74, srv1569370581=41, srv475998199=77, srv1025761541=2, srv626223833=83, srv1758618614=51, srv1830074082=55, srv105213989=6, srv1293935045=26, srv1373065107=29, srv530442000=81, srv753961790=85, srv1980205785=61, srv1476191141=36, srv165748267=47, srv1098439663=9, srv1244815475=25, srv2090442297=64, srv327744709=71, srv874037714=90, srv2106123483=65, srv925262666=94, srv1428082445=32, srv1673764858=48, srv2123638079=68, srv968504442=98, srv1643988896=45, srv269247190=69, srv1185497570=18, srv1539410542=40, srv526042328=80, srv1209479755=19, srv917141302=92, srv1009258831=0, srv1336173377=28, srv884178853=91, srv1096694942=8, srv1862536993=57, srv818196341=88, srv1134001749=13, srv991286236=99, srv814839710=87, srv1233676405=20, srv1148118489=15, srv1440132445=33, srv21104328=66, srv1334334323=27, srv1035442406=4, srv963408193=97, srv1473722954=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:44,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:44,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:44,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:44,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:44,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:44,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:44,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:44,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:44,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:44,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:44,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 12:55:44,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 12:55:44,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 12:55:44,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 12:55:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 12:55:44,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 12:55:44,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 12:55:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 12:55:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 12:55:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 12:55:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 12:55:44,476 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022849726229796613); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033748259297505585, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022849726229796613); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:44,477 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 12:55:44,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014771423425626913, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022849726229796613); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033748259297505585, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022849726229796613); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 12:55:44,811 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 472 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.014771423425626913 to a new imbalance of 9.211755664375411E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008247027829070787); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:44,813 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1800414454:82 , srv1822254922:82 , srv835949495:82 , srv1048142832:83 , srv105213989:83 , srv1096694942:83 , srv1101324612:83 , srv1473722954:83 , srv475998199:83 , srv530442000:83 , srv968504442:83 , srv1028665229:84 , srv1084078970:84 , srv1134001749:84 , srv1235558488:84 , srv1293935045:84 , srv1673764858:84 , srv1681302037:84 , srv1890648451:84 , srv2123638079:84 , srv475716841:84 , srv506296211:84 , srv526042328:84 , srv818196341:84 , srv1014440526:85 , srv1122859885:85 , srv1148118489:85 , srv1176641050:85 , srv1185497570:85 , srv1236818461:85 , srv1421373818:85 , srv1489026906:85 , srv1509498504:85 , srv1750039480:85 , srv1758618614:85 , srv1980205785:85 , srv1985496002:85 , srv2075163973:85 , srv312122360:85 , srv340723187:85 , srv410935951:85 , srv443024242:85 , srv596909172:85 , srv693451743:85 , srv753961790:85 , srv814839710:85 , srv929812220:85 , srv991286236:85 , srv1009258831:86 , srv1025761541:86 , srv1035442406:86 , srv1124922983:86 , srv1144407479:86 , srv117042590:86 , srv1209479755:86 , srv1244815475:86 , srv1373065107:86 , srv1440132445:86 , srv1464129917:86 , srv1476191141:86 , srv1493122318:86 , srv1569370581:86 , srv1601495179:86 , srv1643988896:86 , srv184253854:86 , srv1862536993:86 , srv190180659:86 , srv1945533827:86 , srv2090442297:86 , srv2118491155:86 , srv269247190:86 , srv327744709:86 , srv813520510:86 , srv874037714:86 , srv917841588:86 , srv925262666:86 , srv1098439663:87 , srv1233676405:87 , srv1428082445:87 , srv1603750347:87 , srv163103577:87 , srv1777687299:87 , srv2106123483:87 , srv342789238:87 , srv512043004:87 , srv626223833:87 , srv884178853:87 , srv917141302:87 , srv935681192:87 , srv1242414677:88 , srv1336173377:88 , srv139603495:88 , srv1539410542:88 , srv1830074082:88 , srv21104328:88 , srv963408193:88 , srv1238867818:89 , srv165748267:89 , srv1334334323:90 , srv1649559484:535 }
2023-04-23 12:55:44,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:44,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1601495179=42, srv475716841=76, srv1014440526=1, srv1603750347=43, srv443024242=75, srv1235558488=21, srv1084078970=7, srv917841588=93, srv1101324612=10, srv1800414454=53, srv835949495=89, srv1750039480=50, srv163103577=44, srv1489026906=37, srv1176641050=17, srv1242414677=24, srv512043004=79, srv1236818461=22, srv1945533827=60, srv506296211=78, srv1985496002=62, srv1649559484=46, srv1124922983=12, srv1048142832=5, srv1028665229=3, srv1822254922=54, srv1144407479=14, srv1890648451=58, srv342789238=73, srv117042590=16, srv1122859885=11, srv1681302037=49, srv2118491155=67, srv596909172=82, srv1238867818=23, srv1777687299=52, srv1464129917=34, srv340723187=72, srv935681192=96, srv190180659=59, srv139603495=30, srv184253854=56, srv1493122318=38, srv2075163973=63, srv693451743=84, srv813520510=86, srv929812220=95, srv1509498504=39, srv312122360=70, srv1421373818=31, srv410935951=74, srv1569370581=41, srv475998199=77, srv1025761541=2, srv626223833=83, srv1758618614=51, srv1830074082=55, srv105213989=6, srv1293935045=26, srv1373065107=29, srv530442000=81, srv753961790=85, srv1980205785=61, srv1476191141=36, srv165748267=47, srv1098439663=9, srv1244815475=25, srv2090442297=64, srv327744709=71, srv874037714=90, srv2106123483=65, srv925262666=94, srv1428082445=32, srv1673764858=48, srv2123638079=68, srv968504442=98, srv1643988896=45, srv269247190=69, srv1185497570=18, srv1539410542=40, srv526042328=80, srv1209479755=19, srv917141302=92, srv1009258831=0, srv1336173377=28, srv884178853=91, srv1096694942=8, srv1862536993=57, srv818196341=88, srv1134001749=13, srv991286236=99, srv814839710=87, srv1233676405=20, srv1148118489=15, srv1440132445=33, srv21104328=66, srv1334334323=27, srv1035442406=4, srv963408193=97, srv1473722954=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:44,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:44,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:44,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 12:55:44,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 12:55:44,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 12:55:44,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 12:55:44,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 12:55:44,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 12:55:44,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 12:55:44,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 12:55:44,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 12:55:44,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 12:55:44,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 12:55:44,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 12:55:44,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 12:55:45,007 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008247027829070787); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:45,007 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 12:55:45,007 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.142644447231748E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008247027829070787); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 12:55:45,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 548 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 9.142644447231748E-4 to a new imbalance of 3.303501170674309E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:45,425 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1124922983:83 , srv1334334323:83 , srv165748267:83 , srv1985496002:83 , srv2123638079:83 , srv1096694942:84 , srv1144407479:84 , srv1148118489:84 , srv117042590:84 , srv1185497570:84 , srv1209479755:84 , srv1233676405:84 , srv1236818461:84 , srv1238867818:84 , srv1242414677:84 , srv1244815475:84 , srv139603495:84 , srv1421373818:84 , srv1428082445:84 , srv1440132445:84 , srv1464129917:84 , srv1509498504:84 , srv1539410542:84 , srv163103577:84 , srv1643988896:84 , srv1681302037:84 , srv1750039480:84 , srv1800414454:84 , srv1822254922:84 , srv1830074082:84 , srv1862536993:84 , srv190180659:84 , srv1945533827:84 , srv1980205785:84 , srv21104328:84 , srv342789238:84 , srv410935951:84 , srv443024242:84 , srv475998199:84 , srv512043004:84 , srv753961790:84 , srv814839710:84 , srv818196341:84 , srv884178853:84 , srv963408193:84 , srv991286236:84 , srv1009258831:85 , srv1014440526:85 , srv1025761541:85 , srv1028665229:85 , srv1035442406:85 , srv1048142832:85 , srv105213989:85 , srv1084078970:85 , srv1098439663:85 , srv1122859885:85 , srv1176641050:85 , srv1293935045:85 , srv1336173377:85 , srv1373065107:85 , srv1476191141:85 , srv1489026906:85 , srv1493122318:85 , srv1569370581:85 , srv1601495179:85 , srv1603750347:85 , srv1758618614:85 , srv1777687299:85 , srv184253854:85 , srv1890648451:85 , srv2075163973:85 , srv2090442297:85 , srv2106123483:85 , srv2118491155:85 , srv269247190:85 , srv312122360:85 , srv327744709:85 , srv340723187:85 , srv475716841:85 , srv506296211:85 , srv526042328:85 , srv530442000:85 , srv596909172:85 , srv626223833:85 , srv693451743:85 , srv813520510:85 , srv835949495:85 , srv874037714:85 , srv917141302:85 , srv917841588:85 , srv925262666:85 , srv929812220:85 , srv968504442:85 , srv1101324612:86 , srv1134001749:86 , srv1235558488:86 , srv1473722954:86 , srv1673764858:86 , srv935681192:86 , srv1649559484:630 }
2023-04-23 12:55:45,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:45,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1601495179=42, srv475716841=76, srv1014440526=1, srv1603750347=43, srv443024242=75, srv1235558488=21, srv1084078970=7, srv917841588=93, srv1101324612=10, srv1800414454=53, srv835949495=89, srv1750039480=50, srv163103577=44, srv1489026906=37, srv1176641050=17, srv1242414677=24, srv512043004=79, srv1236818461=22, srv1945533827=60, srv506296211=78, srv1985496002=62, srv1649559484=46, srv1124922983=12, srv1048142832=5, srv1028665229=3, srv1822254922=54, srv1144407479=14, srv1890648451=58, srv342789238=73, srv117042590=16, srv1122859885=11, srv1681302037=49, srv2118491155=67, srv596909172=82, srv1238867818=23, srv1777687299=52, srv1464129917=34, srv340723187=72, srv935681192=96, srv190180659=59, srv139603495=30, srv184253854=56, srv1493122318=38, srv2075163973=63, srv693451743=84, srv813520510=86, srv929812220=95, srv1509498504=39, srv312122360=70, srv1421373818=31, srv410935951=74, srv1569370581=41, srv475998199=77, srv1025761541=2, srv626223833=83, srv1758618614=51, srv1830074082=55, srv105213989=6, srv1293935045=26, srv1373065107=29, srv530442000=81, srv753961790=85, srv1980205785=61, srv1476191141=36, srv165748267=47, srv1098439663=9, srv1244815475=25, srv2090442297=64, srv327744709=71, srv874037714=90, srv2106123483=65, srv925262666=94, srv1428082445=32, srv1673764858=48, srv2123638079=68, srv968504442=98, srv1643988896=45, srv269247190=69, srv1185497570=18, srv1539410542=40, srv526042328=80, srv1209479755=19, srv917141302=92, srv1009258831=0, srv1336173377=28, srv884178853=91, srv1096694942=8, srv1862536993=57, srv818196341=88, srv1134001749=13, srv991286236=99, srv814839710=87, srv1233676405=20, srv1148118489=15, srv1440132445=33, srv21104328=66, srv1334334323=27, srv1035442406=4, srv963408193=97, srv1473722954=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:45,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:45,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:45,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:45,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:45,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:45,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 12:55:45,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 12:55:45,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 12:55:45,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 12:55:45,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 12:55:45,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 12:55:45,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 12:55:45,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 12:55:45,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 12:55:45,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 12:55:45,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 12:55:45,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 12:55:45,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 12:55:45,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 12:55:45,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 12:55:45,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 12:55:45,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 12:55:45,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 12:55:45,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 12:55:45,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 12:55:45,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 12:55:45,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 12:55:45,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 12:55:45,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 12:55:45,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 12:55:45,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 12:55:45,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 12:55:45,603 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:45,603 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 12:55:45,603 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.126346784277686E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 12:55:46,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 3.126346784277686E-5 to a new imbalance of 5.768531687405695E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:46,011 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1235558488:83 , srv1476191141:83 , srv1673764858:83 , srv2075163973:83 , srv526042328:83 , srv917841588:83 , srv935681192:83 , srv1009258831:84 , srv1014440526:84 , srv1025761541:84 , srv1028665229:84 , srv1035442406:84 , srv1048142832:84 , srv105213989:84 , srv1084078970:84 , srv1096694942:84 , srv1098439663:84 , srv1101324612:84 , srv1122859885:84 , srv1124922983:84 , srv1134001749:84 , srv1148118489:84 , srv117042590:84 , srv1176641050:84 , srv1185497570:84 , srv1209479755:84 , srv1233676405:84 , srv1236818461:84 , srv1242414677:84 , srv1244815475:84 , srv1293935045:84 , srv1334334323:84 , srv1336173377:84 , srv1373065107:84 , srv1421373818:84 , srv1428082445:84 , srv1473722954:84 , srv1489026906:84 , srv1493122318:84 , srv1509498504:84 , srv1539410542:84 , srv1569370581:84 , srv1601495179:84 , srv1603750347:84 , srv163103577:84 , srv1643988896:84 , srv165748267:84 , srv1681302037:84 , srv1750039480:84 , srv1758618614:84 , srv1777687299:84 , srv1800414454:84 , srv1822254922:84 , srv1830074082:84 , srv184253854:84 , srv1862536993:84 , srv1890648451:84 , srv190180659:84 , srv1945533827:84 , srv1980205785:84 , srv2090442297:84 , srv2106123483:84 , srv21104328:84 , srv2118491155:84 , srv2123638079:84 , srv269247190:84 , srv312122360:84 , srv327744709:84 , srv340723187:84 , srv410935951:84 , srv443024242:84 , srv475716841:84 , srv475998199:84 , srv506296211:84 , srv512043004:84 , srv530442000:84 , srv596909172:84 , srv626223833:84 , srv693451743:84 , srv753961790:84 , srv813520510:84 , srv814839710:84 , srv818196341:84 , srv835949495:84 , srv874037714:84 , srv884178853:84 , srv917141302:84 , srv925262666:84 , srv929812220:84 , srv963408193:84 , srv968504442:84 , srv991286236:84 , srv1144407479:85 , srv1238867818:85 , srv139603495:85 , srv1440132445:85 , srv1464129917:85 , srv1985496002:85 , srv342789238:85 , srv1649559484:684 }
2023-04-23 12:55:46,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:46,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1601495179=42, srv475716841=76, srv1014440526=1, srv1603750347=43, srv443024242=75, srv1235558488=21, srv1084078970=7, srv917841588=93, srv1101324612=10, srv1800414454=53, srv835949495=89, srv1750039480=50, srv163103577=44, srv1489026906=37, srv1176641050=17, srv1242414677=24, srv512043004=79, srv1236818461=22, srv1945533827=60, srv506296211=78, srv1985496002=62, srv1649559484=46, srv1124922983=12, srv1048142832=5, srv1028665229=3, srv1822254922=54, srv1144407479=14, srv1890648451=58, srv342789238=73, srv117042590=16, srv1122859885=11, srv1681302037=49, srv2118491155=67, srv596909172=82, srv1238867818=23, srv1777687299=52, srv1464129917=34, srv340723187=72, srv935681192=96, srv190180659=59, srv139603495=30, srv184253854=56, srv1493122318=38, srv2075163973=63, srv693451743=84, srv813520510=86, srv929812220=95, srv1509498504=39, srv312122360=70, srv1421373818=31, srv410935951=74, srv1569370581=41, srv475998199=77, srv1025761541=2, srv626223833=83, srv1758618614=51, srv1830074082=55, srv105213989=6, srv1293935045=26, srv1373065107=29, srv530442000=81, srv753961790=85, srv1980205785=61, srv1476191141=36, srv165748267=47, srv1098439663=9, srv1244815475=25, srv2090442297=64, srv327744709=71, srv874037714=90, srv2106123483=65, srv925262666=94, srv1428082445=32, srv1673764858=48, srv2123638079=68, srv968504442=98, srv1643988896=45, srv269247190=69, srv1185497570=18, srv1539410542=40, srv526042328=80, srv1209479755=19, srv917141302=92, srv1009258831=0, srv1336173377=28, srv884178853=91, srv1096694942=8, srv1862536993=57, srv818196341=88, srv1134001749=13, srv991286236=99, srv814839710=87, srv1233676405=20, srv1148118489=15, srv1440132445=33, srv21104328=66, srv1334334323=27, srv1035442406=4, srv963408193=97, srv1473722954=35} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:46,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:46,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:46,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:46,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 12:55:46,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 12:55:46,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 12:55:46,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 12:55:46,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 12:55:46,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 12:55:46,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 12:55:46,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 12:55:46,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 12:55:46,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 12:55:46,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 12:55:46,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 12:55:46,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 12:55:46,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 12:55:46,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 12:55:46,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 12:55:46,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 12:55:46,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 12:55:46,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 12:55:46,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 12:55:46,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 12:55:46,184 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:46,184 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1235558488:83 , srv1476191141:83 , srv1673764858:83 , srv2075163973:83 , srv526042328:83 , srv917841588:83 , srv935681192:83 , srv1009258831:84 , srv1014440526:84 , srv1025761541:84 , srv1028665229:84 , srv1035442406:84 , srv1048142832:84 , srv105213989:84 , srv1084078970:84 , srv1096694942:84 , srv1098439663:84 , srv1101324612:84 , srv1122859885:84 , srv1124922983:84 , srv1134001749:84 , srv1148118489:84 , srv117042590:84 , srv1176641050:84 , srv1185497570:84 , srv1209479755:84 , srv1233676405:84 , srv1236818461:84 , srv1242414677:84 , srv1244815475:84 , srv1293935045:84 , srv1334334323:84 , srv1336173377:84 , srv1373065107:84 , srv1421373818:84 , srv1428082445:84 , srv1473722954:84 , srv1489026906:84 , srv1493122318:84 , srv1509498504:84 , srv1539410542:84 , srv1569370581:84 , srv1601495179:84 , srv1603750347:84 , srv163103577:84 , srv1643988896:84 , srv165748267:84 , srv1681302037:84 , srv1750039480:84 , srv1758618614:84 , srv1777687299:84 , srv1800414454:84 , srv1822254922:84 , srv1830074082:84 , srv184253854:84 , srv1862536993:84 , srv1890648451:84 , srv190180659:84 , srv1945533827:84 , srv1980205785:84 , srv2090442297:84 , srv2106123483:84 , srv21104328:84 , srv2118491155:84 , srv2123638079:84 , srv269247190:84 , srv312122360:84 , srv327744709:84 , srv340723187:84 , srv410935951:84 , srv443024242:84 , srv475716841:84 , srv475998199:84 , srv506296211:84 , srv512043004:84 , srv530442000:84 , srv596909172:84 , srv626223833:84 , srv693451743:84 , srv753961790:84 , srv813520510:84 , srv814839710:84 , srv818196341:84 , srv835949495:84 , srv874037714:84 , srv884178853:84 , srv917141302:84 , srv925262666:84 , srv929812220:84 , srv963408193:84 , srv968504442:84 , srv991286236:84 , srv1144407479:85 , srv1238867818:85 , srv139603495:85 , srv1440132445:85 , srv1464129917:85 , srv1985496002:85 , srv342789238:85 , srv1649559484:684 }
2023-04-23 12:55:46,221 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=469 (was 388) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=12529 (was 13013)
2023-04-23 12:55:46,232 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=469, ProcessCount=169, AvailableMemoryMB=12529
2023-04-23 12:55:46,233 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-23 12:55:46,233 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-23 12:55:46,246 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv104935464:84 , srv1075137658:84 , srv1136611469:84 , srv1160877453:84 , srv1346096615:84 , srv134738622:84 , srv1396862613:84 , srv1657586005:84 , srv1673700363:84 , srv1725068855:84 , srv1736260624:84 , srv1757167673:84 , srv1770571029:84 , srv1839028599:84 , srv1846390589:84 , srv186822256:84 , srv1902597294:84 , srv2035533148:84 , srv211231175:84 , srv245508733:84 , srv311381974:84 , srv430090195:84 , srv431131802:84 , srv580837660:84 , srv690142698:84 , srv741529505:84 , srv753322865:84 , srv80539711:84 , srv946751733:84 , srv593857504:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-23 12:55:46,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:55:46,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1770571029=12, srv1725068855=9, srv211231175=18, srv80539711=28, srv1346096615=4, srv1075137658=1, srv431131802=22, srv104935464=0, srv741529505=26, srv311381974=20, srv186822256=15, srv580837660=23, srv1673700363=8, srv245508733=19, srv1839028599=13, srv593857504=24, srv753322865=27, srv946751733=29, srv134738622=5, srv1160877453=3, srv430090195=21, srv1902597294=16, srv690142698=25, srv1657586005=7, srv1757167673=11, srv1846390589=14, srv2035533148=17, srv1396862613=6, srv1136611469=2, srv1736260624=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:55:46,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:55:46,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:55:46,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:55:46,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:55:46,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:55:46,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:55:46,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:55:46,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-23 12:55:46,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1457234068778646, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:55:46,293 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912652212961045, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1457234068778646, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-23 12:57:46,271 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5776309 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912652212961045 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:57:46,277 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv104935464:90 , srv1075137658:90 , srv1136611469:90 , srv1160877453:90 , srv1346096615:90 , srv134738622:90 , srv1396862613:90 , srv1657586005:90 , srv1673700363:90 , srv1725068855:90 , srv1736260624:90 , srv1757167673:90 , srv1770571029:90 , srv1839028599:90 , srv1846390589:90 , srv186822256:90 , srv1902597294:90 , srv2035533148:90 , srv211231175:90 , srv245508733:90 , srv311381974:90 , srv430090195:90 , srv431131802:90 , srv580837660:90 , srv593857504:90 , srv690142698:90 , srv741529505:90 , srv753322865:90 , srv80539711:90 , srv946751733:90 }
2023-04-23 12:57:46,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 12:57:46,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1770571029=12, srv1725068855=9, srv211231175=18, srv80539711=28, srv1346096615=4, srv1075137658=1, srv431131802=22, srv104935464=0, srv741529505=26, srv311381974=20, srv186822256=15, srv580837660=23, srv1673700363=8, srv245508733=19, srv1839028599=13, srv593857504=24, srv753322865=27, srv946751733=29, srv134738622=5, srv1160877453=3, srv430090195=21, srv1902597294=16, srv690142698=25, srv1657586005=7, srv1757167673=11, srv1846390589=14, srv2035533148=17, srv1396862613=6, srv1136611469=2, srv1736260624=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 12:57:46,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 12:57:46,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 12:57:46,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 12:57:46,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 12:57:46,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 12:57:46,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 12:57:46,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-23 12:57:46,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 12:57:46,294 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv104935464:90 , srv1075137658:90 , srv1136611469:90 , srv1160877453:90 , srv1346096615:90 , srv134738622:90 , srv1396862613:90 , srv1657586005:90 , srv1673700363:90 , srv1725068855:90 , srv1736260624:90 , srv1757167673:90 , srv1770571029:90 , srv1839028599:90 , srv1846390589:90 , srv186822256:90 , srv1902597294:90 , srv2035533148:90 , srv211231175:90 , srv245508733:90 , srv311381974:90 , srv430090195:90 , srv431131802:90 , srv580837660:90 , srv593857504:90 , srv690142698:90 , srv741529505:90 , srv753322865:90 , srv80539711:90 , srv946751733:90 }
2023-04-23 12:57:46,306 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 469), ProcessCount=169 (was 169), AvailableMemoryMB=12579 (was 12529) - AvailableMemoryMB LEAK? -