2023-08-17 21:53:09,955 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-17 21:53:10,283 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-17 21:53:10,395 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-17 21:53:10,460 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-17 21:53:10,467 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-17 21:53:10,485 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=174, AvailableMemoryMB=5865
2023-08-17 21:53:10,487 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-17 21:53:10,488 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-17 21:53:10,640 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1045194677:84 , srv1049751027:84 , srv1050686891:84 , srv107819206:84 , srv1086005471:84 , srv111761622:84 , srv1136001253:84 , srv1138234706:84 , srv1156977288:84 , srv1170306836:84 , srv117116754:84 , srv123671148:84 , srv1271564982:84 , srv1317300826:84 , srv1324992544:84 , srv1349298222:84 , srv1353214652:84 , srv1384515167:84 , srv1403604577:84 , srv1415547032:84 , srv14175264:84 , srv1418906775:84 , srv1510889493:84 , srv1517061012:84 , srv1536210531:84 , srv1579974831:84 , srv1590927307:84 , srv1603929928:84 , srv1641157102:84 , srv167366917:84 , srv1673976313:84 , srv169477164:84 , srv1718974737:84 , srv176526818:84 , srv1808414645:84 , srv1809966483:84 , srv1831762074:84 , srv1867135827:84 , srv1879724214:84 , srv1896708950:84 , srv1943695981:84 , srv1949248717:84 , srv1977047493:84 , srv2008376671:84 , srv2030923133:84 , srv2032452710:84 , srv2042907052:84 , srv2059028633:84 , srv2110526549:84 , srv2132049231:84 , srv213940971:84 , srv2139581188:84 , srv2139877243:84 , srv253837045:84 , srv257811557:84 , srv265139859:84 , srv272885222:84 , srv295045096:84 , srv295481093:84 , srv298649247:84 , srv316693187:84 , srv326269815:84 , srv326501077:84 , srv358030604:84 , srv388388477:84 , srv41263147:84 , srv416142340:84 , srv425142182:84 , srv428836033:84 , srv441691724:84 , srv480618544:84 , srv499704197:84 , srv500038277:84 , srv50464195:84 , srv510964865:84 , srv525596266:84 , srv526659758:84 , srv532410500:84 , srv534329820:84 , srv560908633:84 , srv606073654:84 , srv620238126:84 , srv663328734:84 , srv7512418:84 , srv757524468:84 , srv767392829:84 , srv816801187:84 , srv872146507:84 , srv880543403:84 , srv88363850:84 , srv893305238:84 , srv919134794:84 , srv920294284:84 , srv921627611:84 , srv937869260:84 , srv957296585:84 , srv973837310:84 , srv981784724:84 , srv981962111:84 , srv370860731:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-17 21:53:10,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:10,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv416142340=67, srv2042907052=46, srv872146507=88, srv973837310=97, srv1603929928=27, srv2139581188=51, srv111761622=5, srv880543403=89, srv1415547032=19, srv534329820=79, srv1384515167=17, srv1579974831=25, srv253837045=53, srv500038277=73, srv1170306836=9, srv88363850=90, srv388388477=65, srv1086005471=4, srv1510889493=22, srv2008376671=43, srv757524468=85, srv265139859=55, srv123671148=11, srv326269815=61, srv257811557=54, srv1949248717=41, srv1349298222=15, srv1536210531=24, srv1809966483=35, srv480618544=71, srv1317300826=13, srv1867135827=37, srv2132049231=49, srv7512418=84, srv957296585=96, srv2030923133=44, srv326501077=62, srv1136001253=6, srv1808414645=34, srv358030604=63, srv893305238=91, srv1156977288=8, srv298649247=59, srv1324992544=14, srv41263147=66, srv1673976313=30, srv1718974737=32, srv1831762074=36, srv1353214652=16, srv1138234706=7, srv167366917=29, srv526659758=77, srv14175264=20, srv316693187=60, srv169477164=31, srv117116754=10, srv441691724=70, srv499704197=72, srv370860731=64, srv2110526549=48, srv1977047493=42, srv2032452710=45, srv510964865=75, srv107819206=3, srv560908633=80, srv425142182=68, srv272885222=56, srv1517061012=23, srv1045194677=0, srv1590927307=26, srv295481093=58, srv937869260=95, srv1050686891=2, srv663328734=83, srv1403604577=18, srv295045096=57, srv525596266=76, srv1049751027=1, srv50464195=74, srv1896708950=39, srv1641157102=28, srv2059028633=47, srv428836033=69, srv920294284=93, srv1271564982=12, srv606073654=81, srv1943695981=40, srv620238126=82, srv981784724=98, srv2139877243=52, srv919134794=92, srv921627611=94, srv176526818=33, srv213940971=50, srv816801187=87, srv981962111=99, srv1418906775=21, srv1879724214=38, srv532410500=78, srv767392829=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:10,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:10,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:10,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:10,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:10,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-17 21:53:10,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-17 21:53:10,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-17 21:53:10,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-17 21:53:10,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-17 21:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-17 21:53:10,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-17 21:53:10,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-17 21:53:10,920 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:10,920 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-17 21:53:10,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-17 21:53:11,258 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 4694 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1797104775001238. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038226124574521, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0612239545851073, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5215555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038226124574521, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17458333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:11,271 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv107819206:81 , srv176526818:82 , srv1867135827:82 , srv2030923133:82 , srv326501077:82 , srv1403604577:83 , srv1418906775:83 , srv1590927307:83 , srv1718974737:83 , srv500038277:83 , srv937869260:83 , srv957296585:83 , srv973837310:83 , srv1136001253:84 , srv1579974831:84 , srv441691724:84 , srv620238126:84 , srv816801187:84 , srv880543403:84 , srv893305238:84 , srv1050686891:85 , srv111761622:85 , srv117116754:85 , srv1271564982:85 , srv1384515167:85 , srv1510889493:85 , srv1603929928:85 , srv1641157102:85 , srv1808414645:85 , srv1943695981:85 , srv316693187:85 , srv388388477:85 , srv526659758:85 , srv757524468:85 , srv920294284:85 , srv921627611:85 , srv1138234706:86 , srv1170306836:86 , srv1317300826:86 , srv1324992544:86 , srv1536210531:86 , srv169477164:86 , srv1949248717:86 , srv2032452710:86 , srv2042907052:86 , srv2132049231:86 , srv2139877243:86 , srv253837045:86 , srv257811557:86 , srv295045096:86 , srv428836033:86 , srv532410500:86 , srv534329820:86 , srv560908633:86 , srv7512418:86 , srv872146507:86 , srv981962111:86 , srv1049751027:87 , srv123671148:87 , srv1517061012:87 , srv167366917:87 , srv1809966483:87 , srv1879724214:87 , srv1977047493:87 , srv295481093:87 , srv50464195:87 , srv525596266:87 , srv88363850:87 , srv919134794:87 , srv1045194677:88 , srv14175264:88 , srv2059028633:88 , srv2110526549:88 , srv213940971:88 , srv265139859:88 , srv499704197:88 , srv510964865:88 , srv1086005471:89 , srv1156977288:89 , srv1349298222:89 , srv1415547032:89 , srv2008376671:89 , srv2139581188:89 , srv272885222:89 , srv41263147:89 , srv425142182:89 , srv480618544:89 , srv606073654:89 , srv981784724:89 , srv1353214652:90 , srv1673976313:90 , srv1831762074:90 , srv416142340:90 , srv663328734:90 , srv767392829:90 , srv1896708950:91 , srv326269815:92 , srv358030604:92 , srv298649247:93 , srv370860731:449 }
2023-08-17 21:53:11,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:11,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv416142340=67, srv2042907052=46, srv872146507=88, srv973837310=97, srv1603929928=27, srv2139581188=51, srv111761622=5, srv880543403=89, srv1415547032=19, srv534329820=79, srv1384515167=17, srv1579974831=25, srv253837045=53, srv500038277=73, srv1170306836=9, srv88363850=90, srv388388477=65, srv1086005471=4, srv1510889493=22, srv2008376671=43, srv757524468=85, srv265139859=55, srv123671148=11, srv326269815=61, srv257811557=54, srv1949248717=41, srv1349298222=15, srv1536210531=24, srv1809966483=35, srv480618544=71, srv1317300826=13, srv1867135827=37, srv2132049231=49, srv7512418=84, srv957296585=96, srv2030923133=44, srv326501077=62, srv1136001253=6, srv1808414645=34, srv358030604=63, srv893305238=91, srv1156977288=8, srv298649247=59, srv1324992544=14, srv41263147=66, srv1673976313=30, srv1718974737=32, srv1831762074=36, srv1353214652=16, srv1138234706=7, srv167366917=29, srv526659758=77, srv14175264=20, srv316693187=60, srv169477164=31, srv117116754=10, srv441691724=70, srv499704197=72, srv370860731=64, srv2110526549=48, srv1977047493=42, srv2032452710=45, srv510964865=75, srv107819206=3, srv560908633=80, srv425142182=68, srv272885222=56, srv1517061012=23, srv1045194677=0, srv1590927307=26, srv295481093=58, srv937869260=95, srv1050686891=2, srv663328734=83, srv1403604577=18, srv295045096=57, srv525596266=76, srv1049751027=1, srv50464195=74, srv1896708950=39, srv1641157102=28, srv2059028633=47, srv428836033=69, srv920294284=93, srv1271564982=12, srv606073654=81, srv1943695981=40, srv620238126=82, srv981784724=98, srv2139877243=52, srv919134794=92, srv921627611=94, srv176526818=33, srv213940971=50, srv816801187=87, srv981962111=99, srv1418906775=21, srv1879724214=38, srv532410500=78, srv767392829=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:11,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:11,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:11,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:11,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:11,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-17 21:53:11,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-17 21:53:11,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-17 21:53:11,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-17 21:53:11,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-17 21:53:11,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-17 21:53:11,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-17 21:53:11,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-17 21:53:11,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038226124574521, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0612239545851073, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038226124574521, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17458333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:11,438 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-17 21:53:11,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17967760940962002, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038226124574521, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0612239545851073, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038226124574521, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17458333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-17 21:53:11,780 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 2636 regions; Going from a computed imbalance of 0.17967760940962002 to a new imbalance of 0.01561639970182447. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02408054821001848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03771236166328253, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29288888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02408054821001848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:11,791 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1896708950:80 , srv298649247:80 , srv358030604:80 , srv2008376671:81 , srv326269815:81 , srv88363850:81 , srv1349298222:82 , srv1353214652:82 , srv1517061012:82 , srv1673976313:82 , srv1831762074:82 , srv2139581188:82 , srv416142340:82 , srv480618544:82 , srv981784724:82 , srv1415547032:83 , srv14175264:83 , srv1879724214:83 , srv1977047493:83 , srv272885222:83 , srv41263147:83 , srv606073654:83 , srv663328734:83 , srv767392829:83 , srv919134794:83 , srv1045194677:84 , srv1086005471:84 , srv1156977288:84 , srv1943695981:84 , srv2059028633:84 , srv2139877243:84 , srv295481093:84 , srv499704197:84 , srv50464195:84 , srv525596266:84 , srv872146507:84 , srv1138234706:85 , srv1170306836:85 , srv1384515167:85 , srv169477164:85 , srv2032452710:85 , srv2110526549:85 , srv295045096:85 , srv428836033:85 , srv532410500:85 , srv534329820:85 , srv757524468:85 , srv816801187:85 , srv981962111:85 , srv117116754:86 , srv1536210531:86 , srv167366917:86 , srv1808414645:86 , srv1809966483:86 , srv2042907052:86 , srv2132049231:86 , srv213940971:86 , srv253837045:86 , srv265139859:86 , srv425142182:86 , srv526659758:86 , srv893305238:86 , srv920294284:86 , srv1049751027:87 , srv1136001253:87 , srv1324992544:87 , srv1510889493:87 , srv1579974831:87 , srv1718974737:87 , srv257811557:87 , srv560908633:87 , srv921627611:87 , srv957296585:87 , srv111761622:88 , srv123671148:88 , srv1271564982:88 , srv1403604577:88 , srv1418906775:88 , srv1590927307:88 , srv1603929928:88 , srv1641157102:88 , srv1867135827:88 , srv1949248717:88 , srv316693187:88 , srv441691724:88 , srv510964865:88 , srv620238126:88 , srv7512418:88 , srv937869260:88 , srv973837310:88 , srv1050686891:89 , srv107819206:89 , srv1317300826:89 , srv176526818:89 , srv2030923133:90 , srv500038277:90 , srv388388477:91 , srv880543403:91 , srv326501077:93 , srv370860731:539 }
2023-08-17 21:53:11,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:11,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv416142340=67, srv2042907052=46, srv872146507=88, srv973837310=97, srv1603929928=27, srv2139581188=51, srv111761622=5, srv880543403=89, srv1415547032=19, srv534329820=79, srv1384515167=17, srv1579974831=25, srv253837045=53, srv500038277=73, srv1170306836=9, srv88363850=90, srv388388477=65, srv1086005471=4, srv1510889493=22, srv2008376671=43, srv757524468=85, srv265139859=55, srv123671148=11, srv326269815=61, srv257811557=54, srv1949248717=41, srv1349298222=15, srv1536210531=24, srv1809966483=35, srv480618544=71, srv1317300826=13, srv1867135827=37, srv2132049231=49, srv7512418=84, srv957296585=96, srv2030923133=44, srv326501077=62, srv1136001253=6, srv1808414645=34, srv358030604=63, srv893305238=91, srv1156977288=8, srv298649247=59, srv1324992544=14, srv41263147=66, srv1673976313=30, srv1718974737=32, srv1831762074=36, srv1353214652=16, srv1138234706=7, srv167366917=29, srv526659758=77, srv14175264=20, srv316693187=60, srv169477164=31, srv117116754=10, srv441691724=70, srv499704197=72, srv370860731=64, srv2110526549=48, srv1977047493=42, srv2032452710=45, srv510964865=75, srv107819206=3, srv560908633=80, srv425142182=68, srv272885222=56, srv1517061012=23, srv1045194677=0, srv1590927307=26, srv295481093=58, srv937869260=95, srv1050686891=2, srv663328734=83, srv1403604577=18, srv295045096=57, srv525596266=76, srv1049751027=1, srv50464195=74, srv1896708950=39, srv1641157102=28, srv2059028633=47, srv428836033=69, srv920294284=93, srv1271564982=12, srv606073654=81, srv1943695981=40, srv620238126=82, srv981784724=98, srv2139877243=52, srv919134794=92, srv921627611=94, srv176526818=33, srv213940971=50, srv816801187=87, srv981962111=99, srv1418906775=21, srv1879724214=38, srv532410500=78, srv767392829=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-17 21:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-17 21:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-17 21:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-17 21:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-17 21:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-17 21:53:11,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-17 21:53:11,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-17 21:53:11,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-17 21:53:11,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02408054821001848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03771236166328253, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02408054821001848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:11,943 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-17 21:53:11,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015597942035320854, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02408054821001848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03771236166328253, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02408054821001848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-17 21:53:12,258 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 426 ms to try 5000 different iterations.  Found a solution that moves 1051 regions; Going from a computed imbalance of 0.015597942035320854 to a new imbalance of 6.279488932328979E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008463443686661265); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012143918126978107); MoveCostFunction : (multiplier=7.0, imbalance=0.11677777777777777, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008463443686661265); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:12,259 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv326501077:81 , srv123671148:82 , srv388388477:82 , srv510964865:82 , srv1049751027:83 , srv1317300826:83 , srv1603929928:83 , srv167366917:83 , srv265139859:83 , srv425142182:83 , srv663328734:83 , srv880543403:83 , srv1050686891:84 , srv111761622:84 , srv1156977288:84 , srv1324992544:84 , srv1809966483:84 , srv1949248717:84 , srv2030923133:84 , srv2059028633:84 , srv2110526549:84 , srv213940971:84 , srv257811557:84 , srv416142340:84 , srv560908633:84 , srv7512418:84 , srv767392829:84 , srv1086005471:85 , srv1271564982:85 , srv1403604577:85 , srv1510889493:85 , srv1536210531:85 , srv1641157102:85 , srv169477164:85 , srv1831762074:85 , srv1896708950:85 , srv1977047493:85 , srv2042907052:85 , srv253837045:85 , srv272885222:85 , srv298649247:85 , srv316693187:85 , srv326269815:85 , srv358030604:85 , srv441691724:85 , srv499704197:85 , srv50464195:85 , srv526659758:85 , srv532410500:85 , srv620238126:85 , srv921627611:85 , srv1045194677:86 , srv1138234706:86 , srv117116754:86 , srv1349298222:86 , srv1353214652:86 , srv1415547032:86 , srv1418906775:86 , srv1579974831:86 , srv1590927307:86 , srv1673976313:86 , srv1808414645:86 , srv1867135827:86 , srv2008376671:86 , srv2132049231:86 , srv2139877243:86 , srv295481093:86 , srv41263147:86 , srv500038277:86 , srv534329820:86 , srv606073654:86 , srv981784724:86 , srv107819206:87 , srv1136001253:87 , srv1170306836:87 , srv1384515167:87 , srv14175264:87 , srv1718974737:87 , srv176526818:87 , srv1879724214:87 , srv2032452710:87 , srv2139581188:87 , srv295045096:87 , srv428836033:87 , srv480618544:87 , srv757524468:87 , srv872146507:87 , srv893305238:87 , srv919134794:87 , srv920294284:87 , srv937869260:87 , srv957296585:87 , srv973837310:87 , srv1517061012:88 , srv525596266:88 , srv981962111:88 , srv1943695981:89 , srv816801187:89 , srv88363850:89 , srv370860731:545 }
2023-08-17 21:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv416142340=67, srv2042907052=46, srv872146507=88, srv973837310=97, srv1603929928=27, srv2139581188=51, srv111761622=5, srv880543403=89, srv1415547032=19, srv534329820=79, srv1384515167=17, srv1579974831=25, srv253837045=53, srv500038277=73, srv1170306836=9, srv88363850=90, srv388388477=65, srv1086005471=4, srv1510889493=22, srv2008376671=43, srv757524468=85, srv265139859=55, srv123671148=11, srv326269815=61, srv257811557=54, srv1949248717=41, srv1349298222=15, srv1536210531=24, srv1809966483=35, srv480618544=71, srv1317300826=13, srv1867135827=37, srv2132049231=49, srv7512418=84, srv957296585=96, srv2030923133=44, srv326501077=62, srv1136001253=6, srv1808414645=34, srv358030604=63, srv893305238=91, srv1156977288=8, srv298649247=59, srv1324992544=14, srv41263147=66, srv1673976313=30, srv1718974737=32, srv1831762074=36, srv1353214652=16, srv1138234706=7, srv167366917=29, srv526659758=77, srv14175264=20, srv316693187=60, srv169477164=31, srv117116754=10, srv441691724=70, srv499704197=72, srv370860731=64, srv2110526549=48, srv1977047493=42, srv2032452710=45, srv510964865=75, srv107819206=3, srv560908633=80, srv425142182=68, srv272885222=56, srv1517061012=23, srv1045194677=0, srv1590927307=26, srv295481093=58, srv937869260=95, srv1050686891=2, srv663328734=83, srv1403604577=18, srv295045096=57, srv525596266=76, srv1049751027=1, srv50464195=74, srv1896708950=39, srv1641157102=28, srv2059028633=47, srv428836033=69, srv920294284=93, srv1271564982=12, srv606073654=81, srv1943695981=40, srv620238126=82, srv981784724=98, srv2139877243=52, srv919134794=92, srv921627611=94, srv176526818=33, srv213940971=50, srv816801187=87, srv981962111=99, srv1418906775=21, srv1879724214=38, srv532410500=78, srv767392829=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-17 21:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-17 21:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-17 21:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-17 21:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-17 21:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-17 21:53:12,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008463443686661265); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012143918126978107); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008463443686661265); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:12,402 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-17 21:53:12,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.205896339402951E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008463443686661265); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012143918126978107); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008463443686661265); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-17 21:53:12,734 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 286 regions; Going from a computed imbalance of 6.205896339402951E-4 to a new imbalance of 4.17928904324805E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.03177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:12,735 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv500038277:83 , srv525596266:83 , srv973837310:83 , srv981962111:83 , srv1045194677:84 , srv1050686891:84 , srv1086005471:84 , srv1136001253:84 , srv1156977288:84 , srv1170306836:84 , srv1271564982:84 , srv1317300826:84 , srv1353214652:84 , srv1415547032:84 , srv14175264:84 , srv1641157102:84 , srv1673976313:84 , srv176526818:84 , srv1943695981:84 , srv1949248717:84 , srv2032452710:84 , srv2132049231:84 , srv213940971:84 , srv2139581188:84 , srv295045096:84 , srv298649247:84 , srv316693187:84 , srv326269815:84 , srv41263147:84 , srv425142182:84 , srv428836033:84 , srv480618544:84 , srv510964865:84 , srv7512418:84 , srv816801187:84 , srv880543403:84 , srv919134794:84 , srv920294284:84 , srv937869260:84 , srv1049751027:85 , srv107819206:85 , srv111761622:85 , srv1138234706:85 , srv117116754:85 , srv1324992544:85 , srv1349298222:85 , srv1384515167:85 , srv1418906775:85 , srv1510889493:85 , srv1517061012:85 , srv1536210531:85 , srv1579974831:85 , srv1590927307:85 , srv1718974737:85 , srv1809966483:85 , srv1831762074:85 , srv1879724214:85 , srv2042907052:85 , srv2110526549:85 , srv2139877243:85 , srv253837045:85 , srv257811557:85 , srv265139859:85 , srv272885222:85 , srv295481093:85 , srv358030604:85 , srv388388477:85 , srv441691724:85 , srv499704197:85 , srv534329820:85 , srv560908633:85 , srv606073654:85 , srv620238126:85 , srv757524468:85 , srv767392829:85 , srv872146507:85 , srv88363850:85 , srv893305238:85 , srv921627611:85 , srv957296585:85 , srv981784724:85 , srv123671148:86 , srv1403604577:86 , srv1603929928:86 , srv167366917:86 , srv169477164:86 , srv1808414645:86 , srv1867135827:86 , srv1896708950:86 , srv2008376671:86 , srv2030923133:86 , srv2059028633:86 , srv326501077:86 , srv416142340:86 , srv50464195:86 , srv526659758:86 , srv532410500:86 , srv663328734:86 , srv1977047493:87 , srv370860731:609 }
2023-08-17 21:53:12,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv416142340=67, srv2042907052=46, srv872146507=88, srv973837310=97, srv1603929928=27, srv2139581188=51, srv111761622=5, srv880543403=89, srv1415547032=19, srv534329820=79, srv1384515167=17, srv1579974831=25, srv253837045=53, srv500038277=73, srv1170306836=9, srv88363850=90, srv388388477=65, srv1086005471=4, srv1510889493=22, srv2008376671=43, srv757524468=85, srv265139859=55, srv123671148=11, srv326269815=61, srv257811557=54, srv1949248717=41, srv1349298222=15, srv1536210531=24, srv1809966483=35, srv480618544=71, srv1317300826=13, srv1867135827=37, srv2132049231=49, srv7512418=84, srv957296585=96, srv2030923133=44, srv326501077=62, srv1136001253=6, srv1808414645=34, srv358030604=63, srv893305238=91, srv1156977288=8, srv298649247=59, srv1324992544=14, srv41263147=66, srv1673976313=30, srv1718974737=32, srv1831762074=36, srv1353214652=16, srv1138234706=7, srv167366917=29, srv526659758=77, srv14175264=20, srv316693187=60, srv169477164=31, srv117116754=10, srv441691724=70, srv499704197=72, srv370860731=64, srv2110526549=48, srv1977047493=42, srv2032452710=45, srv510964865=75, srv107819206=3, srv560908633=80, srv425142182=68, srv272885222=56, srv1517061012=23, srv1045194677=0, srv1590927307=26, srv295481093=58, srv937869260=95, srv1050686891=2, srv663328734=83, srv1403604577=18, srv295045096=57, srv525596266=76, srv1049751027=1, srv50464195=74, srv1896708950=39, srv1641157102=28, srv2059028633=47, srv428836033=69, srv920294284=93, srv1271564982=12, srv606073654=81, srv1943695981=40, srv620238126=82, srv981784724=98, srv2139877243=52, srv919134794=92, srv921627611=94, srv176526818=33, srv213940971=50, srv816801187=87, srv981962111=99, srv1418906775=21, srv1879724214=38, srv532410500=78, srv767392829=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:12,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:12,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:12,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:12,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-17 21:53:12,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-17 21:53:12,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-17 21:53:12,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-17 21:53:12,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-17 21:53:12,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-17 21:53:12,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-17 21:53:12,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-17 21:53:12,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-17 21:53:12,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-17 21:53:12,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-17 21:53:12,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-17 21:53:12,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-17 21:53:12,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-17 21:53:12,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-17 21:53:12,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-17 21:53:12,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-17 21:53:12,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-17 21:53:12,908 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:12,908 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-17 21:53:12,909 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.979027562973605E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-17 21:53:13,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 373 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 3.979027562973605E-5 to a new imbalance of 7.269299486807925E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:13,159 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv123671148:83 , srv1808414645:83 , srv388388477:83 , srv606073654:83 , srv1045194677:84 , srv1049751027:84 , srv1050686891:84 , srv107819206:84 , srv1086005471:84 , srv111761622:84 , srv1136001253:84 , srv1138234706:84 , srv1170306836:84 , srv117116754:84 , srv1271564982:84 , srv1317300826:84 , srv1324992544:84 , srv1349298222:84 , srv1353214652:84 , srv1384515167:84 , srv1403604577:84 , srv1415547032:84 , srv14175264:84 , srv1418906775:84 , srv1510889493:84 , srv1517061012:84 , srv1536210531:84 , srv1579974831:84 , srv1590927307:84 , srv1603929928:84 , srv1641157102:84 , srv167366917:84 , srv1673976313:84 , srv169477164:84 , srv1718974737:84 , srv176526818:84 , srv1809966483:84 , srv1831762074:84 , srv1867135827:84 , srv1879724214:84 , srv1896708950:84 , srv1943695981:84 , srv1949248717:84 , srv1977047493:84 , srv2008376671:84 , srv2030923133:84 , srv2032452710:84 , srv2042907052:84 , srv2059028633:84 , srv2110526549:84 , srv2132049231:84 , srv213940971:84 , srv2139581188:84 , srv253837045:84 , srv257811557:84 , srv265139859:84 , srv272885222:84 , srv295045096:84 , srv295481093:84 , srv298649247:84 , srv316693187:84 , srv326269815:84 , srv326501077:84 , srv358030604:84 , srv41263147:84 , srv416142340:84 , srv425142182:84 , srv428836033:84 , srv441691724:84 , srv480618544:84 , srv499704197:84 , srv500038277:84 , srv50464195:84 , srv510964865:84 , srv525596266:84 , srv526659758:84 , srv532410500:84 , srv534329820:84 , srv560908633:84 , srv620238126:84 , srv663328734:84 , srv7512418:84 , srv757524468:84 , srv767392829:84 , srv816801187:84 , srv872146507:84 , srv880543403:84 , srv88363850:84 , srv893305238:84 , srv920294284:84 , srv921627611:84 , srv937869260:84 , srv957296585:84 , srv981784724:84 , srv981962111:84 , srv1156977288:85 , srv2139877243:85 , srv919134794:85 , srv973837310:85 , srv370860731:684 }
2023-08-17 21:53:13,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:13,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv416142340=67, srv2042907052=46, srv872146507=88, srv973837310=97, srv1603929928=27, srv2139581188=51, srv111761622=5, srv880543403=89, srv1415547032=19, srv534329820=79, srv1384515167=17, srv1579974831=25, srv253837045=53, srv500038277=73, srv1170306836=9, srv88363850=90, srv388388477=65, srv1086005471=4, srv1510889493=22, srv2008376671=43, srv757524468=85, srv265139859=55, srv123671148=11, srv326269815=61, srv257811557=54, srv1949248717=41, srv1349298222=15, srv1536210531=24, srv1809966483=35, srv480618544=71, srv1317300826=13, srv1867135827=37, srv2132049231=49, srv7512418=84, srv957296585=96, srv2030923133=44, srv326501077=62, srv1136001253=6, srv1808414645=34, srv358030604=63, srv893305238=91, srv1156977288=8, srv298649247=59, srv1324992544=14, srv41263147=66, srv1673976313=30, srv1718974737=32, srv1831762074=36, srv1353214652=16, srv1138234706=7, srv167366917=29, srv526659758=77, srv14175264=20, srv316693187=60, srv169477164=31, srv117116754=10, srv441691724=70, srv499704197=72, srv370860731=64, srv2110526549=48, srv1977047493=42, srv2032452710=45, srv510964865=75, srv107819206=3, srv560908633=80, srv425142182=68, srv272885222=56, srv1517061012=23, srv1045194677=0, srv1590927307=26, srv295481093=58, srv937869260=95, srv1050686891=2, srv663328734=83, srv1403604577=18, srv295045096=57, srv525596266=76, srv1049751027=1, srv50464195=74, srv1896708950=39, srv1641157102=28, srv2059028633=47, srv428836033=69, srv920294284=93, srv1271564982=12, srv606073654=81, srv1943695981=40, srv620238126=82, srv981784724=98, srv2139877243=52, srv919134794=92, srv921627611=94, srv176526818=33, srv213940971=50, srv816801187=87, srv981962111=99, srv1418906775=21, srv1879724214=38, srv532410500=78, srv767392829=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:13,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:13,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-17 21:53:13,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-17 21:53:13,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-17 21:53:13,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-17 21:53:13,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-17 21:53:13,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-17 21:53:13,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-17 21:53:13,312 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:13,313 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv123671148:83 , srv1808414645:83 , srv388388477:83 , srv606073654:83 , srv1045194677:84 , srv1049751027:84 , srv1050686891:84 , srv107819206:84 , srv1086005471:84 , srv111761622:84 , srv1136001253:84 , srv1138234706:84 , srv1170306836:84 , srv117116754:84 , srv1271564982:84 , srv1317300826:84 , srv1324992544:84 , srv1349298222:84 , srv1353214652:84 , srv1384515167:84 , srv1403604577:84 , srv1415547032:84 , srv14175264:84 , srv1418906775:84 , srv1510889493:84 , srv1517061012:84 , srv1536210531:84 , srv1579974831:84 , srv1590927307:84 , srv1603929928:84 , srv1641157102:84 , srv167366917:84 , srv1673976313:84 , srv169477164:84 , srv1718974737:84 , srv176526818:84 , srv1809966483:84 , srv1831762074:84 , srv1867135827:84 , srv1879724214:84 , srv1896708950:84 , srv1943695981:84 , srv1949248717:84 , srv1977047493:84 , srv2008376671:84 , srv2030923133:84 , srv2032452710:84 , srv2042907052:84 , srv2059028633:84 , srv2110526549:84 , srv2132049231:84 , srv213940971:84 , srv2139581188:84 , srv253837045:84 , srv257811557:84 , srv265139859:84 , srv272885222:84 , srv295045096:84 , srv295481093:84 , srv298649247:84 , srv316693187:84 , srv326269815:84 , srv326501077:84 , srv358030604:84 , srv41263147:84 , srv416142340:84 , srv425142182:84 , srv428836033:84 , srv441691724:84 , srv480618544:84 , srv499704197:84 , srv500038277:84 , srv50464195:84 , srv510964865:84 , srv525596266:84 , srv526659758:84 , srv532410500:84 , srv534329820:84 , srv560908633:84 , srv620238126:84 , srv663328734:84 , srv7512418:84 , srv757524468:84 , srv767392829:84 , srv816801187:84 , srv872146507:84 , srv880543403:84 , srv88363850:84 , srv893305238:84 , srv920294284:84 , srv921627611:84 , srv937869260:84 , srv957296585:84 , srv981784724:84 , srv981962111:84 , srv1156977288:85 , srv2139877243:85 , srv919134794:85 , srv973837310:85 , srv370860731:684 }
2023-08-17 21:53:13,348 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=343 (was 329) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=5008 (was 5865)
2023-08-17 21:53:13,358 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=343, ProcessCount=174, AvailableMemoryMB=5006
2023-08-17 21:53:13,359 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-17 21:53:13,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-17 21:53:13,370 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048825709:84 , srv1112786782:84 , srv1281407669:84 , srv1333786917:84 , srv1637805217:84 , srv1716500066:84 , srv1731954181:84 , srv1780358758:84 , srv1791987921:84 , srv1805918273:84 , srv1812017799:84 , srv1870936827:84 , srv1928126235:84 , srv1928482645:84 , srv1961023844:84 , srv1987815419:84 , srv2003580313:84 , srv2046516453:84 , srv2101941615:84 , srv2132744249:84 , srv2136464337:84 , srv369110898:84 , srv446471279:84 , srv45857794:84 , srv528716231:84 , srv556065372:84 , srv597769720:84 , srv652552963:84 , srv771559018:84 , srv773785910:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-17 21:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:53:13,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2003580313=16, srv1928482645=13, srv2132744249=19, srv771559018=28, srv1637805217=4, srv1780358758=7, srv597769720=26, srv45857794=23, srv1805918273=9, srv2101941615=18, srv1731954181=6, srv1333786917=3, srv652552963=27, srv1928126235=12, srv773785910=29, srv1987815419=15, srv1716500066=5, srv446471279=22, srv369110898=21, srv556065372=25, srv1812017799=10, srv1112786782=1, srv528716231=24, srv2136464337=20, srv1281407669=2, srv2046516453=17, srv1048825709=0, srv1870936827=11, srv1791987921=8, srv1961023844=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-17 21:53:13,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1422308366470242, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:53:13,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912641207986289, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1422308366470242, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-17 21:55:13,385 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6173780 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912641207986289 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:55:13,392 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1048825709:90 , srv1112786782:90 , srv1281407669:90 , srv1333786917:90 , srv1637805217:90 , srv1716500066:90 , srv1731954181:90 , srv1780358758:90 , srv1791987921:90 , srv1805918273:90 , srv1812017799:90 , srv1870936827:90 , srv1928126235:90 , srv1928482645:90 , srv1961023844:90 , srv1987815419:90 , srv2003580313:90 , srv2046516453:90 , srv2101941615:90 , srv2132744249:90 , srv2136464337:90 , srv369110898:90 , srv446471279:90 , srv45857794:90 , srv528716231:90 , srv556065372:90 , srv597769720:90 , srv652552963:90 , srv771559018:90 , srv773785910:90 }
2023-08-17 21:55:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-17 21:55:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2003580313=16, srv1928482645=13, srv2132744249=19, srv771559018=28, srv1637805217=4, srv1780358758=7, srv597769720=26, srv45857794=23, srv1805918273=9, srv2101941615=18, srv1731954181=6, srv1333786917=3, srv652552963=27, srv1928126235=12, srv773785910=29, srv1987815419=15, srv1716500066=5, srv446471279=22, srv369110898=21, srv556065372=25, srv1812017799=10, srv1112786782=1, srv528716231=24, srv2136464337=20, srv1281407669=2, srv2046516453=17, srv1048825709=0, srv1870936827=11, srv1791987921=8, srv1961023844=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-17 21:55:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-17 21:55:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-17 21:55:13,413 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-17 21:55:13,413 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1048825709:90 , srv1112786782:90 , srv1281407669:90 , srv1333786917:90 , srv1637805217:90 , srv1716500066:90 , srv1731954181:90 , srv1780358758:90 , srv1791987921:90 , srv1805918273:90 , srv1812017799:90 , srv1870936827:90 , srv1928126235:90 , srv1928482645:90 , srv1961023844:90 , srv1987815419:90 , srv2003580313:90 , srv2046516453:90 , srv2101941615:90 , srv2132744249:90 , srv2136464337:90 , srv369110898:90 , srv446471279:90 , srv45857794:90 , srv528716231:90 , srv556065372:90 , srv597769720:90 , srv652552963:90 , srv771559018:90 , srv773785910:90 }
2023-08-17 21:55:13,428 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 343), ProcessCount=175 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=4901 (was 5006)