2023-03-04 17:56:15,858 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-04 17:56:16,196 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-04 17:56:16,308 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-04 17:56:16,378 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-04 17:56:16,388 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-04 17:56:16,406 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=100, ProcessCount=173, AvailableMemoryMB=5932
2023-03-04 17:56:16,409 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-04 17:56:16,409 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-04 17:56:16,558 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1025675774:84 , srv106705833:84 , srv1101283434:84 , srv1169996853:84 , srv1187356257:84 , srv1197779786:84 , srv1222824270:84 , srv1244208522:84 , srv1259765883:84 , srv1260905942:84 , srv1321912979:84 , srv1325254081:84 , srv1338677965:84 , srv134935838:84 , srv1395468699:84 , srv1421654121:84 , srv1450769532:84 , srv1457627746:84 , srv1461992273:84 , srv1477162505:84 , srv1484521015:84 , srv1507977029:84 , srv1510864551:84 , srv1511852291:84 , srv1537637696:84 , srv1563063971:84 , srv1626673576:84 , srv1629770697:84 , srv166998006:84 , srv1676860404:84 , srv1722872929:84 , srv1763901994:84 , srv1820648011:84 , srv1843404855:84 , srv1926419290:84 , srv193457972:84 , srv1946083376:84 , srv1949155281:84 , srv195856309:84 , srv1963977513:84 , srv1972254977:84 , srv1975071132:84 , srv1975729837:84 , srv1979648977:84 , srv199904242:84 , srv2022931565:84 , srv2053214806:84 , srv2080591403:84 , srv2090061175:84 , srv2097864895:84 , srv2107901677:84 , srv2113743082:84 , srv2120407281:84 , srv2124332040:84 , srv2126521446:84 , srv240640260:84 , srv298512181:84 , srv299619188:84 , srv301742449:84 , srv302387537:84 , srv347598483:84 , srv348377417:84 , srv381349766:84 , srv397666940:84 , srv415825604:84 , srv422886051:84 , srv441411068:84 , srv466225164:84 , srv487522569:84 , srv527073093:84 , srv535306647:84 , srv535665133:84 , srv540407733:84 , srv572122129:84 , srv578807063:84 , srv601022807:84 , srv602235409:84 , srv610655728:84 , srv614873581:84 , srv631805536:84 , srv639908631:84 , srv657278848:84 , srv664882255:84 , srv687942297:84 , srv71121082:84 , srv720590015:84 , srv767356781:84 , srv78656967:84 , srv809867082:84 , srv831358388:84 , srv847009700:84 , srv860876839:84 , srv92373908:84 , srv943976611:84 , srv94899363:84 , srv957689617:84 , srv974511195:84 , srv975465536:84 , srv981705291:84 , srv1892609705:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-04 17:56:16,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:16,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1511852291=23, srv687942297=84, srv397666940=64, srv974511195=97, srv1626673576=26, srv602235409=77, srv2113743082=52, srv1169996853=3, srv2022931565=46, srv94899363=95, srv2107901677=51, srv2126521446=55, srv422886051=66, srv614873581=79, srv1722872929=30, srv957689617=96, srv1260905942=9, srv415825604=65, srv1101283434=2, srv301742449=59, srv578807063=75, srv1395468699=14, srv1222824270=6, srv1843404855=33, srv441411068=67, srv527073093=70, srv240640260=56, srv1979648977=44, srv847009700=91, srv1926419290=35, srv1484521015=20, srv860876839=92, srv572122129=74, srv487522569=69, srv1820648011=32, srv540407733=73, srv639908631=81, srv1197779786=5, srv809867082=89, srv1676860404=29, srv1244208522=7, srv1461992273=18, srv2097864895=50, srv134935838=13, srv1892609705=34, srv1975071132=42, srv1450769532=16, srv2090061175=49, srv1507977029=21, srv981705291=99, srv975465536=98, srv1510864551=22, srv1963977513=40, srv1421654121=15, srv1325254081=11, srv298512181=57, srv1187356257=4, srv92373908=93, srv348377417=62, srv1259765883=8, srv720590015=86, srv1025675774=0, srv71121082=85, srv193457972=36, srv2124332040=54, srv199904242=45, srv1763901994=31, srv1975729837=43, srv2120407281=53, srv1946083376=37, srv1972254977=41, srv1477162505=19, srv299619188=58, srv195856309=39, srv302387537=60, srv1537637696=24, srv106705833=1, srv767356781=87, srv1949155281=38, srv631805536=80, srv664882255=83, srv166998006=28, srv2080591403=48, srv535306647=71, srv466225164=68, srv601022807=76, srv535665133=72, srv943976611=94, srv381349766=63, srv1563063971=25, srv831358388=90, srv1629770697=27, srv1338677965=12, srv1321912979=10, srv2053214806=47, srv1457627746=17, srv78656967=88, srv347598483=61, srv610655728=78, srv657278848=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 17:56:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 17:56:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 17:56:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 17:56:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 17:56:16,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 17:56:16,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 17:56:16,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 17:56:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 17:56:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 17:56:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 17:56:16,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 17:56:16,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 17:56:16,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 17:56:16,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 17:56:16,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:16,926 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 17:56:16,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 17:56:17,223 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 497 ms to try 5000 different iterations.  Found a solution that moves 4683 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17850060059060774. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041408666249996104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056363817385032065, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5203333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041408666249996104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17366666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:17,239 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1537637696:82 , srv1563063971:82 , srv1972254977:82 , srv601022807:82 , srv1507977029:83 , srv1843404855:83 , srv809867082:83 , srv94899363:83 , srv1421654121:84 , srv1450769532:84 , srv1511852291:84 , srv1975729837:84 , srv1979648977:84 , srv2080591403:84 , srv2113743082:84 , srv240640260:84 , srv302387537:84 , srv381349766:84 , srv397666940:84 , srv415825604:84 , srv540407733:84 , srv572122129:84 , srv687942297:84 , srv1025675774:85 , srv1169996853:85 , srv1222824270:85 , srv1244208522:85 , srv1259765883:85 , srv1260905942:85 , srv1395468699:85 , srv1763901994:85 , srv1820648011:85 , srv193457972:85 , srv1946083376:85 , srv195856309:85 , srv1963977513:85 , srv2090061175:85 , srv2126521446:85 , srv301742449:85 , srv487522569:85 , srv527073093:85 , srv535306647:85 , srv71121082:85 , srv767356781:85 , srv78656967:85 , srv92373908:85 , srv957689617:85 , srv974511195:85 , srv106705833:86 , srv1197779786:86 , srv1321912979:86 , srv1461992273:86 , srv1626673576:86 , srv166998006:86 , srv1676860404:86 , srv1926419290:86 , srv2120407281:86 , srv348377417:86 , srv535665133:86 , srv631805536:86 , srv657278848:86 , srv1187356257:87 , srv1325254081:87 , srv1457627746:87 , srv1477162505:87 , srv199904242:87 , srv2107901677:87 , srv298512181:87 , srv299619188:87 , srv466225164:87 , srv602235409:87 , srv614873581:87 , srv639908631:87 , srv981705291:87 , srv1338677965:88 , srv1629770697:88 , srv2053214806:88 , srv347598483:88 , srv441411068:88 , srv610655728:88 , srv847009700:88 , srv1101283434:89 , srv1484521015:89 , srv1510864551:89 , srv1722872929:89 , srv1949155281:89 , srv422886051:89 , srv664882255:89 , srv134935838:90 , srv2022931565:90 , srv975465536:90 , srv2124332040:91 , srv578807063:91 , srv720590015:91 , srv831358388:91 , srv860876839:91 , srv2097864895:92 , srv943976611:93 , srv1975071132:99 , srv1892609705:458 }
2023-03-04 17:56:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1511852291=23, srv687942297=84, srv397666940=64, srv974511195=97, srv1626673576=26, srv602235409=77, srv2113743082=52, srv1169996853=3, srv2022931565=46, srv94899363=95, srv2107901677=51, srv2126521446=55, srv422886051=66, srv614873581=79, srv1722872929=30, srv957689617=96, srv1260905942=9, srv415825604=65, srv1101283434=2, srv301742449=59, srv578807063=75, srv1395468699=14, srv1222824270=6, srv1843404855=33, srv441411068=67, srv527073093=70, srv240640260=56, srv1979648977=44, srv847009700=91, srv1926419290=35, srv1484521015=20, srv860876839=92, srv572122129=74, srv487522569=69, srv1820648011=32, srv540407733=73, srv639908631=81, srv1197779786=5, srv809867082=89, srv1676860404=29, srv1244208522=7, srv1461992273=18, srv2097864895=50, srv134935838=13, srv1892609705=34, srv1975071132=42, srv1450769532=16, srv2090061175=49, srv1507977029=21, srv981705291=99, srv975465536=98, srv1510864551=22, srv1963977513=40, srv1421654121=15, srv1325254081=11, srv298512181=57, srv1187356257=4, srv92373908=93, srv348377417=62, srv1259765883=8, srv720590015=86, srv1025675774=0, srv71121082=85, srv193457972=36, srv2124332040=54, srv199904242=45, srv1763901994=31, srv1975729837=43, srv2120407281=53, srv1946083376=37, srv1972254977=41, srv1477162505=19, srv299619188=58, srv195856309=39, srv302387537=60, srv1537637696=24, srv106705833=1, srv767356781=87, srv1949155281=38, srv631805536=80, srv664882255=83, srv166998006=28, srv2080591403=48, srv535306647=71, srv466225164=68, srv601022807=76, srv535665133=72, srv943976611=94, srv381349766=63, srv1563063971=25, srv831358388=90, srv1629770697=27, srv1338677965=12, srv1321912979=10, srv2053214806=47, srv1457627746=17, srv78656967=88, srv347598483=61, srv610655728=78, srv657278848=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:17,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:17,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:17,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:17,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 17:56:17,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 17:56:17,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 17:56:17,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 17:56:17,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 17:56:17,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 17:56:17,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 17:56:17,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 17:56:17,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 17:56:17,431 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041408666249996104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056363817385032065, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041408666249996104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17366666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:17,432 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 17:56:17,432 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17846780952375016, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041408666249996104, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056363817385032065, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041408666249996104, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17366666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 17:56:17,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 421 ms to try 5000 different iterations.  Found a solution that moves 2597 regions; Going from a computed imbalance of 0.17846780952375016 to a new imbalance of 0.01673967437975569. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02252155304735435); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03731444928846544, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28855555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02252155304735435); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:17,741 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1975071132:73 , srv2022931565:80 , srv2124332040:80 , srv943976611:80 , srv664882255:81 , srv831358388:81 , srv1101283434:82 , srv1338677965:82 , srv134935838:82 , srv1629770697:82 , srv1722872929:82 , srv2097864895:82 , srv2107901677:82 , srv422886051:82 , srv1461992273:83 , srv1484521015:83 , srv1510864551:83 , srv1949155281:83 , srv2053214806:83 , srv578807063:83 , srv610655728:83 , srv720590015:83 , srv860876839:83 , srv106705833:84 , srv1820648011:84 , srv298512181:84 , srv299619188:84 , srv441411068:84 , srv92373908:84 , srv1222824270:85 , srv166998006:85 , srv1946083376:85 , srv1963977513:85 , srv199904242:85 , srv2120407281:85 , srv347598483:85 , srv535665133:85 , srv614873581:85 , srv71121082:85 , srv1169996853:86 , srv1187356257:86 , srv1260905942:86 , srv1325254081:86 , srv1457627746:86 , srv1511852291:86 , srv1926419290:86 , srv2080591403:86 , srv2126521446:86 , srv487522569:86 , srv572122129:86 , srv602235409:86 , srv631805536:86 , srv639908631:86 , srv78656967:86 , srv974511195:86 , srv1197779786:87 , srv1321912979:87 , srv1395468699:87 , srv1421654121:87 , srv1450769532:87 , srv1477162505:87 , srv1626673576:87 , srv1676860404:87 , srv1763901994:87 , srv2090061175:87 , srv2113743082:87 , srv240640260:87 , srv348377417:87 , srv381349766:87 , srv466225164:87 , srv527073093:87 , srv847009700:87 , srv957689617:87 , srv1025675774:88 , srv1244208522:88 , srv1259765883:88 , srv1507977029:88 , srv1843404855:88 , srv195856309:88 , srv1975729837:88 , srv301742449:88 , srv302387537:88 , srv415825604:88 , srv767356781:88 , srv94899363:88 , srv981705291:88 , srv1537637696:89 , srv193457972:89 , srv1972254977:89 , srv1979648977:89 , srv535306647:89 , srv657278848:89 , srv397666940:90 , srv540407733:90 , srv601022807:90 , srv687942297:90 , srv809867082:90 , srv975465536:90 , srv1563063971:92 , srv1892609705:516 }
2023-03-04 17:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:17,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1511852291=23, srv687942297=84, srv397666940=64, srv974511195=97, srv1626673576=26, srv602235409=77, srv2113743082=52, srv1169996853=3, srv2022931565=46, srv94899363=95, srv2107901677=51, srv2126521446=55, srv422886051=66, srv614873581=79, srv1722872929=30, srv957689617=96, srv1260905942=9, srv415825604=65, srv1101283434=2, srv301742449=59, srv578807063=75, srv1395468699=14, srv1222824270=6, srv1843404855=33, srv441411068=67, srv527073093=70, srv240640260=56, srv1979648977=44, srv847009700=91, srv1926419290=35, srv1484521015=20, srv860876839=92, srv572122129=74, srv487522569=69, srv1820648011=32, srv540407733=73, srv639908631=81, srv1197779786=5, srv809867082=89, srv1676860404=29, srv1244208522=7, srv1461992273=18, srv2097864895=50, srv134935838=13, srv1892609705=34, srv1975071132=42, srv1450769532=16, srv2090061175=49, srv1507977029=21, srv981705291=99, srv975465536=98, srv1510864551=22, srv1963977513=40, srv1421654121=15, srv1325254081=11, srv298512181=57, srv1187356257=4, srv92373908=93, srv348377417=62, srv1259765883=8, srv720590015=86, srv1025675774=0, srv71121082=85, srv193457972=36, srv2124332040=54, srv199904242=45, srv1763901994=31, srv1975729837=43, srv2120407281=53, srv1946083376=37, srv1972254977=41, srv1477162505=19, srv299619188=58, srv195856309=39, srv302387537=60, srv1537637696=24, srv106705833=1, srv767356781=87, srv1949155281=38, srv631805536=80, srv664882255=83, srv166998006=28, srv2080591403=48, srv535306647=71, srv466225164=68, srv601022807=76, srv535665133=72, srv943976611=94, srv381349766=63, srv1563063971=25, srv831358388=90, srv1629770697=27, srv1338677965=12, srv1321912979=10, srv2053214806=47, srv1457627746=17, srv78656967=88, srv347598483=61, srv610655728=78, srv657278848=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 17:56:17,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 17:56:17,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 17:56:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 17:56:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 17:56:17,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 17:56:17,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 17:56:17,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 17:56:17,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02252155304735435); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03731444928846544, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02252155304735435); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:17,869 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 17:56:17,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01672148979708881, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02252155304735435); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03731444928846544, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02252155304735435); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 17:56:18,149 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 375 ms to try 5000 different iterations.  Found a solution that moves 900 regions; Going from a computed imbalance of 0.01672148979708881 to a new imbalance of 0.0011312045124620659. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009017033665330906); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011920047906260363); MoveCostFunction : (multiplier=7.0, imbalance=0.1, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009017033665330906); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:18,151 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv975465536:77 , srv1197779786:83 , srv1477162505:83 , srv1563063971:83 , srv1626673576:83 , srv1676860404:83 , srv397666940:83 , srv535306647:83 , srv540407733:83 , srv578807063:83 , srv657278848:83 , srv720590015:83 , srv809867082:83 , srv847009700:83 , srv981705291:83 , srv1244208522:84 , srv1259765883:84 , srv134935838:84 , srv1457627746:84 , srv193457972:84 , srv199904242:84 , srv2097864895:84 , srv347598483:84 , srv348377417:84 , srv415825604:84 , srv466225164:84 , srv602235409:84 , srv639908631:84 , srv687942297:84 , srv860876839:84 , srv1187356257:85 , srv1260905942:85 , srv1321912979:85 , srv1325254081:85 , srv1395468699:85 , srv1484521015:85 , srv1507977029:85 , srv1510864551:85 , srv1926419290:85 , srv1949155281:85 , srv195856309:85 , srv1975729837:85 , srv1979648977:85 , srv2090061175:85 , srv2120407281:85 , srv298512181:85 , srv301742449:85 , srv302387537:85 , srv610655728:85 , srv614873581:85 , srv631805536:85 , srv767356781:85 , srv78656967:85 , srv831358388:85 , srv943976611:85 , srv957689617:85 , srv1025675774:86 , srv1169996853:86 , srv1338677965:86 , srv1511852291:86 , srv1722872929:86 , srv1843404855:86 , srv1946083376:86 , srv1963977513:86 , srv1972254977:86 , srv1975071132:86 , srv2053214806:86 , srv2113743082:86 , srv2124332040:86 , srv2126521446:86 , srv299619188:86 , srv381349766:86 , srv422886051:86 , srv441411068:86 , srv527073093:86 , srv601022807:86 , srv94899363:86 , srv974511195:86 , srv106705833:87 , srv1101283434:87 , srv1222824270:87 , srv1450769532:87 , srv1537637696:87 , srv1629770697:87 , srv166998006:87 , srv1763901994:87 , srv240640260:87 , srv487522569:87 , srv535665133:87 , srv664882255:87 , srv71121082:87 , srv1421654121:88 , srv1461992273:88 , srv1820648011:88 , srv2022931565:88 , srv2080591403:88 , srv2107901677:88 , srv572122129:88 , srv92373908:88 , srv1892609705:564 }
2023-03-04 17:56:18,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:18,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1511852291=23, srv687942297=84, srv397666940=64, srv974511195=97, srv1626673576=26, srv602235409=77, srv2113743082=52, srv1169996853=3, srv2022931565=46, srv94899363=95, srv2107901677=51, srv2126521446=55, srv422886051=66, srv614873581=79, srv1722872929=30, srv957689617=96, srv1260905942=9, srv415825604=65, srv1101283434=2, srv301742449=59, srv578807063=75, srv1395468699=14, srv1222824270=6, srv1843404855=33, srv441411068=67, srv527073093=70, srv240640260=56, srv1979648977=44, srv847009700=91, srv1926419290=35, srv1484521015=20, srv860876839=92, srv572122129=74, srv487522569=69, srv1820648011=32, srv540407733=73, srv639908631=81, srv1197779786=5, srv809867082=89, srv1676860404=29, srv1244208522=7, srv1461992273=18, srv2097864895=50, srv134935838=13, srv1892609705=34, srv1975071132=42, srv1450769532=16, srv2090061175=49, srv1507977029=21, srv981705291=99, srv975465536=98, srv1510864551=22, srv1963977513=40, srv1421654121=15, srv1325254081=11, srv298512181=57, srv1187356257=4, srv92373908=93, srv348377417=62, srv1259765883=8, srv720590015=86, srv1025675774=0, srv71121082=85, srv193457972=36, srv2124332040=54, srv199904242=45, srv1763901994=31, srv1975729837=43, srv2120407281=53, srv1946083376=37, srv1972254977=41, srv1477162505=19, srv299619188=58, srv195856309=39, srv302387537=60, srv1537637696=24, srv106705833=1, srv767356781=87, srv1949155281=38, srv631805536=80, srv664882255=83, srv166998006=28, srv2080591403=48, srv535306647=71, srv466225164=68, srv601022807=76, srv535665133=72, srv943976611=94, srv381349766=63, srv1563063971=25, srv831358388=90, srv1629770697=27, srv1338677965=12, srv1321912979=10, srv2053214806=47, srv1457627746=17, srv78656967=88, srv347598483=61, srv610655728=78, srv657278848=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:18,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:18,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 17:56:18,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 17:56:18,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 17:56:18,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 17:56:18,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 17:56:18,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 17:56:18,291 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009017033665330906); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011920047906260363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009017033665330906); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:18,291 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 17:56:18,291 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.001124902577768115, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009017033665330906); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011920047906260363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009017033665330906); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 17:56:18,572 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 379 ms to try 5000 different iterations.  Found a solution that moves 307 regions; Going from a computed imbalance of 0.001124902577768115 to a new imbalance of 3.565889399497354E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.03411111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:18,573 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1421654121:83 , srv1763901994:83 , srv2097864895:83 , srv527073093:83 , srv535665133:83 , srv1025675774:84 , srv1101283434:84 , srv1187356257:84 , srv1321912979:84 , srv1325254081:84 , srv1395468699:84 , srv1450769532:84 , srv1537637696:84 , srv166998006:84 , srv1722872929:84 , srv193457972:84 , srv1949155281:84 , srv195856309:84 , srv1975071132:84 , srv1979648977:84 , srv2022931565:84 , srv2080591403:84 , srv2124332040:84 , srv240640260:84 , srv348377417:84 , srv422886051:84 , srv441411068:84 , srv466225164:84 , srv487522569:84 , srv572122129:84 , srv601022807:84 , srv657278848:84 , srv831358388:84 , srv847009700:84 , srv943976611:84 , srv106705833:85 , srv1169996853:85 , srv1222824270:85 , srv1244208522:85 , srv1457627746:85 , srv1461992273:85 , srv1484521015:85 , srv1510864551:85 , srv1511852291:85 , srv1563063971:85 , srv1626673576:85 , srv1629770697:85 , srv1820648011:85 , srv1843404855:85 , srv1926419290:85 , srv1975729837:85 , srv2053214806:85 , srv2090061175:85 , srv2107901677:85 , srv2126521446:85 , srv298512181:85 , srv299619188:85 , srv301742449:85 , srv302387537:85 , srv347598483:85 , srv381349766:85 , srv397666940:85 , srv535306647:85 , srv578807063:85 , srv602235409:85 , srv614873581:85 , srv631805536:85 , srv639908631:85 , srv664882255:85 , srv687942297:85 , srv71121082:85 , srv720590015:85 , srv767356781:85 , srv860876839:85 , srv94899363:85 , srv957689617:85 , srv975465536:85 , srv981705291:85 , srv1197779786:86 , srv1259765883:86 , srv1260905942:86 , srv1338677965:86 , srv134935838:86 , srv1477162505:86 , srv1507977029:86 , srv1676860404:86 , srv1946083376:86 , srv1963977513:86 , srv1972254977:86 , srv199904242:86 , srv2113743082:86 , srv2120407281:86 , srv415825604:86 , srv540407733:86 , srv610655728:86 , srv78656967:86 , srv809867082:86 , srv92373908:86 , srv974511195:86 , srv1892609705:604 }
2023-03-04 17:56:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1511852291=23, srv687942297=84, srv397666940=64, srv974511195=97, srv1626673576=26, srv602235409=77, srv2113743082=52, srv1169996853=3, srv2022931565=46, srv94899363=95, srv2107901677=51, srv2126521446=55, srv422886051=66, srv614873581=79, srv1722872929=30, srv957689617=96, srv1260905942=9, srv415825604=65, srv1101283434=2, srv301742449=59, srv578807063=75, srv1395468699=14, srv1222824270=6, srv1843404855=33, srv441411068=67, srv527073093=70, srv240640260=56, srv1979648977=44, srv847009700=91, srv1926419290=35, srv1484521015=20, srv860876839=92, srv572122129=74, srv487522569=69, srv1820648011=32, srv540407733=73, srv639908631=81, srv1197779786=5, srv809867082=89, srv1676860404=29, srv1244208522=7, srv1461992273=18, srv2097864895=50, srv134935838=13, srv1892609705=34, srv1975071132=42, srv1450769532=16, srv2090061175=49, srv1507977029=21, srv981705291=99, srv975465536=98, srv1510864551=22, srv1963977513=40, srv1421654121=15, srv1325254081=11, srv298512181=57, srv1187356257=4, srv92373908=93, srv348377417=62, srv1259765883=8, srv720590015=86, srv1025675774=0, srv71121082=85, srv193457972=36, srv2124332040=54, srv199904242=45, srv1763901994=31, srv1975729837=43, srv2120407281=53, srv1946083376=37, srv1972254977=41, srv1477162505=19, srv299619188=58, srv195856309=39, srv302387537=60, srv1537637696=24, srv106705833=1, srv767356781=87, srv1949155281=38, srv631805536=80, srv664882255=83, srv166998006=28, srv2080591403=48, srv535306647=71, srv466225164=68, srv601022807=76, srv535665133=72, srv943976611=94, srv381349766=63, srv1563063971=25, srv831358388=90, srv1629770697=27, srv1338677965=12, srv1321912979=10, srv2053214806=47, srv1457627746=17, srv78656967=88, srv347598483=61, srv610655728=78, srv657278848=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:18,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 17:56:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 17:56:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 17:56:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 17:56:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 17:56:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 17:56:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 17:56:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 17:56:18,701 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:18,702 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 17:56:18,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.3509234049370244E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 17:56:18,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 369 ms to try 5000 different iterations.  Found a solution that moves 33 regions; Going from a computed imbalance of 3.3509234049370244E-5 to a new imbalance of 6.263149678506573E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0036666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:18,973 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1025675774:83 , srv1259765883:83 , srv1477162505:83 , srv1972254977:83 , srv2113743082:83 , srv301742449:83 , srv540407733:83 , srv687942297:83 , srv767356781:83 , srv860876839:83 , srv92373908:83 , srv974511195:83 , srv981705291:83 , srv106705833:84 , srv1101283434:84 , srv1169996853:84 , srv1187356257:84 , srv1197779786:84 , srv1222824270:84 , srv1244208522:84 , srv1260905942:84 , srv1321912979:84 , srv1325254081:84 , srv1338677965:84 , srv134935838:84 , srv1421654121:84 , srv1450769532:84 , srv1457627746:84 , srv1461992273:84 , srv1484521015:84 , srv1507977029:84 , srv1510864551:84 , srv1537637696:84 , srv1563063971:84 , srv1629770697:84 , srv166998006:84 , srv1676860404:84 , srv1763901994:84 , srv1820648011:84 , srv1843404855:84 , srv1926419290:84 , srv193457972:84 , srv1946083376:84 , srv195856309:84 , srv1963977513:84 , srv1975071132:84 , srv1975729837:84 , srv1979648977:84 , srv199904242:84 , srv2022931565:84 , srv2053214806:84 , srv2080591403:84 , srv2090061175:84 , srv2107901677:84 , srv2120407281:84 , srv2126521446:84 , srv240640260:84 , srv299619188:84 , srv302387537:84 , srv347598483:84 , srv381349766:84 , srv397666940:84 , srv415825604:84 , srv441411068:84 , srv466225164:84 , srv487522569:84 , srv535306647:84 , srv572122129:84 , srv578807063:84 , srv601022807:84 , srv602235409:84 , srv610655728:84 , srv614873581:84 , srv631805536:84 , srv639908631:84 , srv657278848:84 , srv664882255:84 , srv71121082:84 , srv720590015:84 , srv78656967:84 , srv809867082:84 , srv847009700:84 , srv943976611:84 , srv94899363:84 , srv957689617:84 , srv975465536:84 , srv1395468699:85 , srv1511852291:85 , srv1626673576:85 , srv1722872929:85 , srv1949155281:85 , srv2097864895:85 , srv2124332040:85 , srv298512181:85 , srv348377417:85 , srv422886051:85 , srv527073093:85 , srv535665133:85 , srv831358388:85 , srv1892609705:684 }
2023-03-04 17:56:18,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:18,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1511852291=23, srv687942297=84, srv397666940=64, srv974511195=97, srv1626673576=26, srv602235409=77, srv2113743082=52, srv1169996853=3, srv2022931565=46, srv94899363=95, srv2107901677=51, srv2126521446=55, srv422886051=66, srv614873581=79, srv1722872929=30, srv957689617=96, srv1260905942=9, srv415825604=65, srv1101283434=2, srv301742449=59, srv578807063=75, srv1395468699=14, srv1222824270=6, srv1843404855=33, srv441411068=67, srv527073093=70, srv240640260=56, srv1979648977=44, srv847009700=91, srv1926419290=35, srv1484521015=20, srv860876839=92, srv572122129=74, srv487522569=69, srv1820648011=32, srv540407733=73, srv639908631=81, srv1197779786=5, srv809867082=89, srv1676860404=29, srv1244208522=7, srv1461992273=18, srv2097864895=50, srv134935838=13, srv1892609705=34, srv1975071132=42, srv1450769532=16, srv2090061175=49, srv1507977029=21, srv981705291=99, srv975465536=98, srv1510864551=22, srv1963977513=40, srv1421654121=15, srv1325254081=11, srv298512181=57, srv1187356257=4, srv92373908=93, srv348377417=62, srv1259765883=8, srv720590015=86, srv1025675774=0, srv71121082=85, srv193457972=36, srv2124332040=54, srv199904242=45, srv1763901994=31, srv1975729837=43, srv2120407281=53, srv1946083376=37, srv1972254977=41, srv1477162505=19, srv299619188=58, srv195856309=39, srv302387537=60, srv1537637696=24, srv106705833=1, srv767356781=87, srv1949155281=38, srv631805536=80, srv664882255=83, srv166998006=28, srv2080591403=48, srv535306647=71, srv466225164=68, srv601022807=76, srv535665133=72, srv943976611=94, srv381349766=63, srv1563063971=25, srv831358388=90, srv1629770697=27, srv1338677965=12, srv1321912979=10, srv2053214806=47, srv1457627746=17, srv78656967=88, srv347598483=61, srv610655728=78, srv657278848=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:18,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:18,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 17:56:18,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 17:56:18,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 17:56:18,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 17:56:18,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 17:56:19,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:19,108 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1025675774:83 , srv1259765883:83 , srv1477162505:83 , srv1972254977:83 , srv2113743082:83 , srv301742449:83 , srv540407733:83 , srv687942297:83 , srv767356781:83 , srv860876839:83 , srv92373908:83 , srv974511195:83 , srv981705291:83 , srv106705833:84 , srv1101283434:84 , srv1169996853:84 , srv1187356257:84 , srv1197779786:84 , srv1222824270:84 , srv1244208522:84 , srv1260905942:84 , srv1321912979:84 , srv1325254081:84 , srv1338677965:84 , srv134935838:84 , srv1421654121:84 , srv1450769532:84 , srv1457627746:84 , srv1461992273:84 , srv1484521015:84 , srv1507977029:84 , srv1510864551:84 , srv1537637696:84 , srv1563063971:84 , srv1629770697:84 , srv166998006:84 , srv1676860404:84 , srv1763901994:84 , srv1820648011:84 , srv1843404855:84 , srv1926419290:84 , srv193457972:84 , srv1946083376:84 , srv195856309:84 , srv1963977513:84 , srv1975071132:84 , srv1975729837:84 , srv1979648977:84 , srv199904242:84 , srv2022931565:84 , srv2053214806:84 , srv2080591403:84 , srv2090061175:84 , srv2107901677:84 , srv2120407281:84 , srv2126521446:84 , srv240640260:84 , srv299619188:84 , srv302387537:84 , srv347598483:84 , srv381349766:84 , srv397666940:84 , srv415825604:84 , srv441411068:84 , srv466225164:84 , srv487522569:84 , srv535306647:84 , srv572122129:84 , srv578807063:84 , srv601022807:84 , srv602235409:84 , srv610655728:84 , srv614873581:84 , srv631805536:84 , srv639908631:84 , srv657278848:84 , srv664882255:84 , srv71121082:84 , srv720590015:84 , srv78656967:84 , srv809867082:84 , srv847009700:84 , srv943976611:84 , srv94899363:84 , srv957689617:84 , srv975465536:84 , srv1395468699:85 , srv1511852291:85 , srv1626673576:85 , srv1722872929:85 , srv1949155281:85 , srv2097864895:85 , srv2124332040:85 , srv298512181:85 , srv348377417:85 , srv422886051:85 , srv527073093:85 , srv535665133:85 , srv831358388:85 , srv1892609705:684 }
2023-03-04 17:56:19,135 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 100) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=5433 (was 5932)
2023-03-04 17:56:19,142 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=140, ProcessCount=173, AvailableMemoryMB=5433
2023-03-04 17:56:19,143 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-04 17:56:19,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-04 17:56:19,151 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1121435871:84 , srv1190179490:84 , srv1280156245:84 , srv1313714253:84 , srv1321677982:84 , srv1326955238:84 , srv1402179144:84 , srv1441691889:84 , srv172890188:84 , srv1849378085:84 , srv1881349489:84 , srv1940979872:84 , srv1990152255:84 , srv234668470:84 , srv285875103:84 , srv359640068:84 , srv398594734:84 , srv398640613:84 , srv55550724:84 , srv659074182:84 , srv69277158:84 , srv700261339:84 , srv721874301:84 , srv722103204:84 , srv76732225:84 , srv769210704:84 , srv770483282:84 , srv778946891:84 , srv960907512:84 , srv1780310720:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-04 17:56:19,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:56:19,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1441691889=7, srv1940979872=12, srv69277158=21, srv172890188=8, srv285875103=15, srv398594734=17, srv1321677982=4, srv1190179490=1, srv700261339=22, srv659074182=20, srv76732225=25, srv1780310720=9, srv960907512=29, srv359640068=16, srv398640613=18, srv1402179144=6, srv778946891=28, srv722103204=24, srv1313714253=3, srv1326955238=5, srv1990152255=13, srv234668470=14, srv1121435871=0, srv1280156245=2, srv1849378085=10, srv1881349489=11, srv770483282=27, srv721874301=23, srv55550724=19, srv769210704=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:56:19,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:56:19,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-04 17:56:19,176 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0700609016708234, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:56:19,176 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912413802877746, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0700609016708234, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-04 17:58:19,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6393285 different iterations.  Found a solution that moves 1846 regions; Going from a computed imbalance of 0.9912413802877746 to a new imbalance of 4.308656090753194E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6837037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:58:19,171 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1121435871:90 , srv1190179490:90 , srv1280156245:90 , srv1313714253:90 , srv1321677982:90 , srv1326955238:90 , srv1402179144:90 , srv1441691889:90 , srv172890188:90 , srv1780310720:90 , srv1849378085:90 , srv1881349489:90 , srv1940979872:90 , srv1990152255:90 , srv234668470:90 , srv285875103:90 , srv359640068:90 , srv398594734:90 , srv398640613:90 , srv55550724:90 , srv659074182:90 , srv69277158:90 , srv700261339:90 , srv721874301:90 , srv722103204:90 , srv76732225:90 , srv769210704:90 , srv770483282:90 , srv778946891:90 , srv960907512:90 }
2023-03-04 17:58:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 17:58:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1441691889=7, srv1940979872=12, srv69277158=21, srv172890188=8, srv285875103=15, srv398594734=17, srv1321677982=4, srv1190179490=1, srv700261339=22, srv659074182=20, srv76732225=25, srv1780310720=9, srv960907512=29, srv359640068=16, srv398640613=18, srv1402179144=6, srv778946891=28, srv722103204=24, srv1313714253=3, srv1326955238=5, srv1990152255=13, srv234668470=14, srv1121435871=0, srv1280156245=2, srv1849378085=10, srv1881349489=11, srv770483282=27, srv721874301=23, srv55550724=19, srv769210704=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 17:58:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 17:58:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 17:58:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-04 17:58:19,196 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 17:58:19,197 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1121435871:90 , srv1190179490:90 , srv1280156245:90 , srv1313714253:90 , srv1321677982:90 , srv1326955238:90 , srv1402179144:90 , srv1441691889:90 , srv172890188:90 , srv1780310720:90 , srv1849378085:90 , srv1881349489:90 , srv1940979872:90 , srv1990152255:90 , srv234668470:90 , srv285875103:90 , srv359640068:90 , srv398594734:90 , srv398640613:90 , srv55550724:90 , srv659074182:90 , srv69277158:90 , srv700261339:90 , srv721874301:90 , srv722103204:90 , srv76732225:90 , srv769210704:90 , srv770483282:90 , srv778946891:90 , srv960907512:90 }
2023-03-04 17:58:19,212 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 140) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 173), AvailableMemoryMB=5802 (was 5433) - AvailableMemoryMB LEAK? -