2024-01-27 08:53:13,444 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-27 08:53:13,761 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-27 08:53:13,886 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-27 08:53:13,951 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-27 08:53:13,958 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-27 08:53:13,971 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=167, AvailableMemoryMB=6620
2024-01-27 08:53:13,974 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-27 08:53:13,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-27 08:53:14,101 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1030748844:84 , srv1077595705:84 , srv1093007429:84 , srv1094042986:84 , srv1113239706:84 , srv1122149292:84 , srv1122734451:84 , srv1123744245:84 , srv1178769233:84 , srv1202863274:84 , srv1215231267:84 , srv1215488405:84 , srv1234356808:84 , srv1237247084:84 , srv1306537893:84 , srv1313591295:84 , srv1361416594:84 , srv138286760:84 , srv1385912435:84 , srv1418559955:84 , srv1420584872:84 , srv1424083629:84 , srv1445183641:84 , srv1480101368:84 , srv1482986893:84 , srv1489356575:84 , srv1489524304:84 , srv1542282687:84 , srv1568838532:84 , srv1586781093:84 , srv1591031286:84 , srv164236149:84 , srv1642384255:84 , srv1644637247:84 , srv1650849598:84 , srv1656478023:84 , srv1666547544:84 , srv1681504837:84 , srv1796491410:84 , srv1817154892:84 , srv1823234349:84 , srv1827287908:84 , srv1860304241:84 , srv1878205024:84 , srv1906993494:84 , srv1933729674:84 , srv1947198261:84 , srv2022691848:84 , srv2029282092:84 , srv2070466547:84 , srv207628480:84 , srv2078365404:84 , srv2084578546:84 , srv2104491461:84 , srv2128047223:84 , srv2134678610:84 , srv224695347:84 , srv284761137:84 , srv291516538:84 , srv294275701:84 , srv305925176:84 , srv311497957:84 , srv337856239:84 , srv366408317:84 , srv381893394:84 , srv390934416:84 , srv411500919:84 , srv422642211:84 , srv444488631:84 , srv444587770:84 , srv45441790:84 , srv459641236:84 , srv482894036:84 , srv497377346:84 , srv527546080:84 , srv534546057:84 , srv567421420:84 , srv637004545:84 , srv648335989:84 , srv653839068:84 , srv654566399:84 , srv682375124:84 , srv700489603:84 , srv709551057:84 , srv710729740:84 , srv729761158:84 , srv764585564:84 , srv790389661:84 , srv809724039:84 , srv811638099:84 , srv827970284:84 , srv842693193:84 , srv853214541:84 , srv870278292:84 , srv880413132:84 , srv900582069:84 , srv930943369:84 , srv94716256:84 , srv991198069:84 , srv1611941122:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-27 08:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:14,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv311497957=62, srv809724039=89, srv2022691848=48, srv700489603=83, srv827970284=91, srv422642211=68, srv534546057=76, srv1306537893=14, srv567421420=77, srv138286760=17, srv366408317=64, srv729761158=86, srv1642384255=33, srv1215231267=10, srv337856239=63, srv207628480=51, srv1178769233=8, srv1424083629=21, srv811638099=90, srv1860304241=43, srv390934416=66, srv1313591295=15, srv709551057=84, srv1542282687=27, srv444488631=69, srv653839068=80, srv1611941122=31, srv284761137=58, srv1093007429=2, srv2078365404=52, srv880413132=95, srv224695347=57, srv1122149292=5, srv1489356575=25, srv1947198261=47, srv1480101368=23, srv1591031286=30, srv1666547544=37, srv2134678610=56, srv305925176=61, srv710729740=85, srv497377346=74, srv2104491461=54, srv1489524304=26, srv1817154892=40, srv648335989=79, srv1445183641=22, srv381893394=65, srv2084578546=53, srv527546080=75, srv2070466547=50, srv900582069=96, srv1215488405=11, srv291516538=59, srv94716256=98, srv1420584872=20, srv1123744245=7, srv930943369=97, srv164236149=32, srv1796491410=39, srv1656478023=36, srv682375124=82, srv2128047223=55, srv1823234349=41, srv482894036=73, srv459641236=72, srv637004545=78, srv853214541=93, srv1122734451=6, srv1094042986=3, srv1906993494=45, srv1361416594=16, srv1568838532=28, srv1586781093=29, srv1077595705=1, srv1827287908=42, srv1933729674=46, srv1202863274=9, srv764585564=87, srv1482986893=24, srv790389661=88, srv1030748844=0, srv2029282092=49, srv842693193=92, srv991198069=99, srv1644637247=34, srv1234356808=12, srv1650849598=35, srv1385912435=18, srv1113239706=4, srv870278292=94, srv1418559955=19, srv45441790=71, srv294275701=60, srv1878205024=44, srv654566399=81, srv411500919=67, srv1681504837=38, srv1237247084=13, srv444587770=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:14,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:14,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:14,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:14,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:14,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:14,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:14,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:14,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:14,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:14,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:14,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:14,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-27 08:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-27 08:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-27 08:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-27 08:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-27 08:53:14,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-27 08:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-27 08:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-27 08:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-27 08:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-27 08:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-27 08:53:14,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-27 08:53:14,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-27 08:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-27 08:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-27 08:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-27 08:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-27 08:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-27 08:53:14,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-27 08:53:14,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-27 08:53:14,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-27 08:53:14,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-27 08:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-27 08:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-27 08:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-27 08:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-27 08:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-27 08:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-27 08:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-27 08:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-27 08:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-27 08:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-27 08:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-27 08:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-27 08:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-27 08:53:14,749 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:14,749 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-27 08:53:14,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-27 08:53:15,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1164 ms to try 5000 different iterations.  Found a solution that moves 4772 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17574764995263917. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038603893987541875, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05764748323415623, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5302222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038603893987541875, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23683333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:15,451 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv790389661:81 , srv1823234349:82 , srv2070466547:82 , srv291516538:82 , srv870278292:82 , srv207628480:83 , srv390934416:83 , srv444587770:83 , srv729761158:83 , srv1234356808:84 , srv1361416594:84 , srv1480101368:84 , srv1644637247:84 , srv1650849598:84 , srv1906993494:84 , srv2104491461:84 , srv366408317:84 , srv381893394:84 , srv482894036:84 , srv653839068:84 , srv682375124:84 , srv827970284:84 , srv842693193:84 , srv930943369:84 , srv1113239706:85 , srv1178769233:85 , srv1237247084:85 , srv1418559955:85 , srv1489356575:85 , srv1827287908:85 , srv1860304241:85 , srv2022691848:85 , srv567421420:85 , srv648335989:85 , srv811638099:85 , srv1077595705:86 , srv1093007429:86 , srv1123744245:86 , srv1306537893:86 , srv1420584872:86 , srv1489524304:86 , srv1591031286:86 , srv164236149:86 , srv1817154892:86 , srv1933729674:86 , srv2029282092:86 , srv2078365404:86 , srv2084578546:86 , srv2134678610:86 , srv284761137:86 , srv411500919:86 , srv459641236:86 , srv1030748844:87 , srv138286760:87 , srv1385912435:87 , srv1482986893:87 , srv1542282687:87 , srv1878205024:87 , srv294275701:87 , srv654566399:87 , srv709551057:87 , srv809724039:87 , srv991198069:87 , srv1122734451:88 , srv1215231267:88 , srv1215488405:88 , srv1313591295:88 , srv1445183641:88 , srv1642384255:88 , srv1666547544:88 , srv1796491410:88 , srv2128047223:88 , srv305925176:88 , srv422642211:88 , srv444488631:88 , srv764585564:88 , srv853214541:88 , srv94716256:88 , srv1122149292:89 , srv1202863274:89 , srv1568838532:89 , srv1586781093:89 , srv1947198261:89 , srv311497957:89 , srv534546057:89 , srv637004545:89 , srv700489603:89 , srv710729740:89 , srv880413132:89 , srv900582069:89 , srv1094042986:90 , srv1424083629:90 , srv224695347:90 , srv45441790:90 , srv1656478023:91 , srv497377346:91 , srv1681504837:92 , srv337856239:93 , srv527546080:97 , srv1611941122:433 }
2024-01-27 08:53:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv311497957=62, srv809724039=89, srv2022691848=48, srv700489603=83, srv827970284=91, srv422642211=68, srv534546057=76, srv1306537893=14, srv567421420=77, srv138286760=17, srv366408317=64, srv729761158=86, srv1642384255=33, srv1215231267=10, srv337856239=63, srv207628480=51, srv1178769233=8, srv1424083629=21, srv811638099=90, srv1860304241=43, srv390934416=66, srv1313591295=15, srv709551057=84, srv1542282687=27, srv444488631=69, srv653839068=80, srv1611941122=31, srv284761137=58, srv1093007429=2, srv2078365404=52, srv880413132=95, srv224695347=57, srv1122149292=5, srv1489356575=25, srv1947198261=47, srv1480101368=23, srv1591031286=30, srv1666547544=37, srv2134678610=56, srv305925176=61, srv710729740=85, srv497377346=74, srv2104491461=54, srv1489524304=26, srv1817154892=40, srv648335989=79, srv1445183641=22, srv381893394=65, srv2084578546=53, srv527546080=75, srv2070466547=50, srv900582069=96, srv1215488405=11, srv291516538=59, srv94716256=98, srv1420584872=20, srv1123744245=7, srv930943369=97, srv164236149=32, srv1796491410=39, srv1656478023=36, srv682375124=82, srv2128047223=55, srv1823234349=41, srv482894036=73, srv459641236=72, srv637004545=78, srv853214541=93, srv1122734451=6, srv1094042986=3, srv1906993494=45, srv1361416594=16, srv1568838532=28, srv1586781093=29, srv1077595705=1, srv1827287908=42, srv1933729674=46, srv1202863274=9, srv764585564=87, srv1482986893=24, srv790389661=88, srv1030748844=0, srv2029282092=49, srv842693193=92, srv991198069=99, srv1644637247=34, srv1234356808=12, srv1650849598=35, srv1385912435=18, srv1113239706=4, srv870278292=94, srv1418559955=19, srv45441790=71, srv294275701=60, srv1878205024=44, srv654566399=81, srv411500919=67, srv1681504837=38, srv1237247084=13, srv444587770=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:15,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:15,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:15,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-27 08:53:15,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-27 08:53:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-27 08:53:15,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-27 08:53:15,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-27 08:53:15,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-27 08:53:15,654 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038603893987541875, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05764748323415623, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038603893987541875, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23683333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:15,654 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-27 08:53:15,654 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1757142356944619, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038603893987541875, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05764748323415623, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038603893987541875, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23683333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-27 08:53:15,986 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 486 ms to try 5000 different iterations.  Found a solution that moves 2571 regions; Going from a computed imbalance of 0.1757142356944619 to a new imbalance of 0.01567017082103649. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022162095987652113); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03847835253641906, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2856666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022162095987652113); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:15,997 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv527546080:74 , srv337856239:77 , srv1094042986:80 , srv1202863274:81 , srv1215488405:82 , srv1586781093:82 , srv1656478023:82 , srv1681504837:82 , srv1796491410:82 , srv224695347:82 , srv45441790:82 , srv637004545:82 , srv700489603:82 , srv1122734451:83 , srv1424083629:83 , srv1542282687:83 , srv1642384255:83 , srv2128047223:83 , srv2134678610:83 , srv311497957:83 , srv444488631:83 , srv497377346:83 , srv710729740:83 , srv900582069:83 , srv1113239706:84 , srv1122149292:84 , srv1489524304:84 , srv1878205024:84 , srv1947198261:84 , srv709551057:84 , srv853214541:84 , srv880413132:84 , srv94716256:84 , srv1030748844:85 , srv1077595705:85 , srv1215231267:85 , srv1313591295:85 , srv1385912435:85 , srv1420584872:85 , srv1445183641:85 , srv1568838532:85 , srv1591031286:85 , srv164236149:85 , srv305925176:85 , srv422642211:85 , srv534546057:85 , srv764585564:85 , srv809724039:85 , srv991198069:85 , srv1093007429:86 , srv1123744245:86 , srv138286760:86 , srv1418559955:86 , srv1482986893:86 , srv1489356575:86 , srv1666547544:86 , srv2029282092:86 , srv2078365404:86 , srv2084578546:86 , srv284761137:86 , srv411500919:86 , srv459641236:86 , srv653839068:86 , srv827970284:86 , srv1178769233:87 , srv1234356808:87 , srv1480101368:87 , srv1650849598:87 , srv2022691848:87 , srv207628480:87 , srv294275701:87 , srv482894036:87 , srv567421420:87 , srv648335989:87 , srv842693193:87 , srv930943369:87 , srv1237247084:88 , srv1361416594:88 , srv1817154892:88 , srv1860304241:88 , srv1906993494:88 , srv1933729674:88 , srv2104491461:88 , srv390934416:88 , srv654566399:88 , srv682375124:88 , srv729761158:88 , srv1644637247:89 , srv291516538:89 , srv366408317:89 , srv381893394:89 , srv444587770:89 , srv1306537893:90 , srv1823234349:90 , srv1827287908:90 , srv811638099:90 , srv2070466547:92 , srv790389661:92 , srv870278292:92 , srv1611941122:538 }
2024-01-27 08:53:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv311497957=62, srv809724039=89, srv2022691848=48, srv700489603=83, srv827970284=91, srv422642211=68, srv534546057=76, srv1306537893=14, srv567421420=77, srv138286760=17, srv366408317=64, srv729761158=86, srv1642384255=33, srv1215231267=10, srv337856239=63, srv207628480=51, srv1178769233=8, srv1424083629=21, srv811638099=90, srv1860304241=43, srv390934416=66, srv1313591295=15, srv709551057=84, srv1542282687=27, srv444488631=69, srv653839068=80, srv1611941122=31, srv284761137=58, srv1093007429=2, srv2078365404=52, srv880413132=95, srv224695347=57, srv1122149292=5, srv1489356575=25, srv1947198261=47, srv1480101368=23, srv1591031286=30, srv1666547544=37, srv2134678610=56, srv305925176=61, srv710729740=85, srv497377346=74, srv2104491461=54, srv1489524304=26, srv1817154892=40, srv648335989=79, srv1445183641=22, srv381893394=65, srv2084578546=53, srv527546080=75, srv2070466547=50, srv900582069=96, srv1215488405=11, srv291516538=59, srv94716256=98, srv1420584872=20, srv1123744245=7, srv930943369=97, srv164236149=32, srv1796491410=39, srv1656478023=36, srv682375124=82, srv2128047223=55, srv1823234349=41, srv482894036=73, srv459641236=72, srv637004545=78, srv853214541=93, srv1122734451=6, srv1094042986=3, srv1906993494=45, srv1361416594=16, srv1568838532=28, srv1586781093=29, srv1077595705=1, srv1827287908=42, srv1933729674=46, srv1202863274=9, srv764585564=87, srv1482986893=24, srv790389661=88, srv1030748844=0, srv2029282092=49, srv842693193=92, srv991198069=99, srv1644637247=34, srv1234356808=12, srv1650849598=35, srv1385912435=18, srv1113239706=4, srv870278292=94, srv1418559955=19, srv45441790=71, srv294275701=60, srv1878205024=44, srv654566399=81, srv411500919=67, srv1681504837=38, srv1237247084=13, srv444587770=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-27 08:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-27 08:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-27 08:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-27 08:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-27 08:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-27 08:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-27 08:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-27 08:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-27 08:53:16,162 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022162095987652113); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03847835253641906, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022162095987652113); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:16,163 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-27 08:53:16,163 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01565216829426077, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022162095987652113); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03847835253641906, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022162095987652113); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-27 08:53:16,482 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 438 ms to try 5000 different iterations.  Found a solution that moves 1017 regions; Going from a computed imbalance of 0.01565216829426077 to a new imbalance of 8.775932319927634E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006549665409178627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011370704872299221); MoveCostFunction : (multiplier=7.0, imbalance=0.113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006549665409178627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:16,486 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1306537893:81 , srv1568838532:82 , srv654566399:82 , srv1122149292:83 , srv1666547544:83 , srv1827287908:83 , srv1933729674:83 , srv534546057:83 , srv1215231267:84 , srv1445183641:84 , srv1482986893:84 , srv1644637247:84 , srv1681504837:84 , srv1817154892:84 , srv1947198261:84 , srv2070466547:84 , srv366408317:84 , srv422642211:84 , srv497377346:84 , srv764585564:84 , srv790389661:84 , srv870278292:84 , srv1030748844:85 , srv1093007429:85 , srv1178769233:85 , srv1237247084:85 , srv1313591295:85 , srv1361416594:85 , srv138286760:85 , srv1385912435:85 , srv1424083629:85 , srv1656478023:85 , srv1823234349:85 , srv1860304241:85 , srv1906993494:85 , srv2022691848:85 , srv2078365404:85 , srv224695347:85 , srv284761137:85 , srv294275701:85 , srv305925176:85 , srv311497957:85 , srv381893394:85 , srv411500919:85 , srv459641236:85 , srv567421420:85 , srv710729740:85 , srv809724039:85 , srv811638099:85 , srv853214541:85 , srv880413132:85 , srv900582069:85 , srv94716256:85 , srv1077595705:86 , srv1122734451:86 , srv1123744245:86 , srv1215488405:86 , srv1420584872:86 , srv1480101368:86 , srv1591031286:86 , srv164236149:86 , srv1642384255:86 , srv1650849598:86 , srv2084578546:86 , srv2104491461:86 , srv2128047223:86 , srv291516538:86 , srv390934416:86 , srv444488631:86 , srv45441790:86 , srv637004545:86 , srv648335989:86 , srv682375124:86 , srv709551057:86 , srv729761158:86 , srv991198069:86 , srv1202863274:87 , srv1234356808:87 , srv1418559955:87 , srv1489356575:87 , srv1489524304:87 , srv1542282687:87 , srv1586781093:87 , srv1796491410:87 , srv1878205024:87 , srv2029282092:87 , srv207628480:87 , srv444587770:87 , srv482894036:87 , srv527546080:87 , srv700489603:87 , srv827970284:87 , srv842693193:87 , srv930943369:87 , srv1094042986:88 , srv1113239706:88 , srv2134678610:88 , srv337856239:88 , srv653839068:88 , srv1611941122:545 }
2024-01-27 08:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv311497957=62, srv809724039=89, srv2022691848=48, srv700489603=83, srv827970284=91, srv422642211=68, srv534546057=76, srv1306537893=14, srv567421420=77, srv138286760=17, srv366408317=64, srv729761158=86, srv1642384255=33, srv1215231267=10, srv337856239=63, srv207628480=51, srv1178769233=8, srv1424083629=21, srv811638099=90, srv1860304241=43, srv390934416=66, srv1313591295=15, srv709551057=84, srv1542282687=27, srv444488631=69, srv653839068=80, srv1611941122=31, srv284761137=58, srv1093007429=2, srv2078365404=52, srv880413132=95, srv224695347=57, srv1122149292=5, srv1489356575=25, srv1947198261=47, srv1480101368=23, srv1591031286=30, srv1666547544=37, srv2134678610=56, srv305925176=61, srv710729740=85, srv497377346=74, srv2104491461=54, srv1489524304=26, srv1817154892=40, srv648335989=79, srv1445183641=22, srv381893394=65, srv2084578546=53, srv527546080=75, srv2070466547=50, srv900582069=96, srv1215488405=11, srv291516538=59, srv94716256=98, srv1420584872=20, srv1123744245=7, srv930943369=97, srv164236149=32, srv1796491410=39, srv1656478023=36, srv682375124=82, srv2128047223=55, srv1823234349=41, srv482894036=73, srv459641236=72, srv637004545=78, srv853214541=93, srv1122734451=6, srv1094042986=3, srv1906993494=45, srv1361416594=16, srv1568838532=28, srv1586781093=29, srv1077595705=1, srv1827287908=42, srv1933729674=46, srv1202863274=9, srv764585564=87, srv1482986893=24, srv790389661=88, srv1030748844=0, srv2029282092=49, srv842693193=92, srv991198069=99, srv1644637247=34, srv1234356808=12, srv1650849598=35, srv1385912435=18, srv1113239706=4, srv870278292=94, srv1418559955=19, srv45441790=71, srv294275701=60, srv1878205024=44, srv654566399=81, srv411500919=67, srv1681504837=38, srv1237247084=13, srv444587770=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:16,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:16,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:16,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:16,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-27 08:53:16,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-27 08:53:16,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-27 08:53:16,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-27 08:53:16,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-27 08:53:16,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-27 08:53:16,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-27 08:53:16,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-27 08:53:16,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-27 08:53:16,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-27 08:53:16,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-27 08:53:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-27 08:53:16,674 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006549665409178627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011370704872299221); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006549665409178627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:16,674 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-27 08:53:16,674 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.704720457885987E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006549665409178627); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011370704872299221); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006549665409178627); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-27 08:53:17,086 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 546 ms to try 5000 different iterations.  Found a solution that moves 273 regions; Going from a computed imbalance of 8.704720457885987E-4 to a new imbalance of 2.7459330002051743E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.030333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:17,087 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv811638099:82 , srv2029282092:83 , srv294275701:83 , srv444587770:83 , srv880413132:83 , srv1094042986:84 , srv1123744245:84 , srv1234356808:84 , srv1237247084:84 , srv1313591295:84 , srv138286760:84 , srv1418559955:84 , srv1424083629:84 , srv1445183641:84 , srv1480101368:84 , srv1489356575:84 , srv1542282687:84 , srv1586781093:84 , srv1656478023:84 , srv1681504837:84 , srv1817154892:84 , srv1827287908:84 , srv1860304241:84 , srv1878205024:84 , srv1947198261:84 , srv2070466547:84 , srv2084578546:84 , srv2104491461:84 , srv305925176:84 , srv337856239:84 , srv45441790:84 , srv497377346:84 , srv527546080:84 , srv648335989:84 , srv654566399:84 , srv682375124:84 , srv700489603:84 , srv764585564:84 , srv842693193:84 , srv870278292:84 , srv991198069:84 , srv1030748844:85 , srv1077595705:85 , srv1093007429:85 , srv1113239706:85 , srv1122734451:85 , srv1178769233:85 , srv1202863274:85 , srv1215231267:85 , srv1306537893:85 , srv1361416594:85 , srv1385912435:85 , srv1420584872:85 , srv1482986893:85 , srv1489524304:85 , srv1591031286:85 , srv164236149:85 , srv1642384255:85 , srv1644637247:85 , srv1650849598:85 , srv1796491410:85 , srv1823234349:85 , srv1906993494:85 , srv1933729674:85 , srv2022691848:85 , srv207628480:85 , srv2078365404:85 , srv2128047223:85 , srv2134678610:85 , srv284761137:85 , srv291516538:85 , srv311497957:85 , srv366408317:85 , srv381893394:85 , srv390934416:85 , srv411500919:85 , srv422642211:85 , srv444488631:85 , srv459641236:85 , srv482894036:85 , srv567421420:85 , srv637004545:85 , srv653839068:85 , srv709551057:85 , srv710729740:85 , srv729761158:85 , srv790389661:85 , srv809724039:85 , srv827970284:85 , srv853214541:85 , srv900582069:85 , srv930943369:85 , srv94716256:85 , srv1122149292:86 , srv1215488405:86 , srv1568838532:86 , srv1666547544:86 , srv224695347:86 , srv534546057:86 , srv1611941122:626 }
2024-01-27 08:53:17,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:17,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv311497957=62, srv809724039=89, srv2022691848=48, srv700489603=83, srv827970284=91, srv422642211=68, srv534546057=76, srv1306537893=14, srv567421420=77, srv138286760=17, srv366408317=64, srv729761158=86, srv1642384255=33, srv1215231267=10, srv337856239=63, srv207628480=51, srv1178769233=8, srv1424083629=21, srv811638099=90, srv1860304241=43, srv390934416=66, srv1313591295=15, srv709551057=84, srv1542282687=27, srv444488631=69, srv653839068=80, srv1611941122=31, srv284761137=58, srv1093007429=2, srv2078365404=52, srv880413132=95, srv224695347=57, srv1122149292=5, srv1489356575=25, srv1947198261=47, srv1480101368=23, srv1591031286=30, srv1666547544=37, srv2134678610=56, srv305925176=61, srv710729740=85, srv497377346=74, srv2104491461=54, srv1489524304=26, srv1817154892=40, srv648335989=79, srv1445183641=22, srv381893394=65, srv2084578546=53, srv527546080=75, srv2070466547=50, srv900582069=96, srv1215488405=11, srv291516538=59, srv94716256=98, srv1420584872=20, srv1123744245=7, srv930943369=97, srv164236149=32, srv1796491410=39, srv1656478023=36, srv682375124=82, srv2128047223=55, srv1823234349=41, srv482894036=73, srv459641236=72, srv637004545=78, srv853214541=93, srv1122734451=6, srv1094042986=3, srv1906993494=45, srv1361416594=16, srv1568838532=28, srv1586781093=29, srv1077595705=1, srv1827287908=42, srv1933729674=46, srv1202863274=9, srv764585564=87, srv1482986893=24, srv790389661=88, srv1030748844=0, srv2029282092=49, srv842693193=92, srv991198069=99, srv1644637247=34, srv1234356808=12, srv1650849598=35, srv1385912435=18, srv1113239706=4, srv870278292=94, srv1418559955=19, srv45441790=71, srv294275701=60, srv1878205024=44, srv654566399=81, srv411500919=67, srv1681504837=38, srv1237247084=13, srv444587770=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-27 08:53:17,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-27 08:53:17,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-27 08:53:17,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-27 08:53:17,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-27 08:53:17,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-27 08:53:17,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:17,230 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-27 08:53:17,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5547743144886592E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-27 08:53:17,545 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 425 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 2.5547743144886592E-5 to a new imbalance of 7.822462643889748E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:17,546 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1666547544:83 , srv224695347:83 , srv381893394:83 , srv482894036:83 , srv534546057:83 , srv653839068:83 , srv930943369:83 , srv1030748844:84 , srv1077595705:84 , srv1093007429:84 , srv1094042986:84 , srv1113239706:84 , srv1122149292:84 , srv1122734451:84 , srv1123744245:84 , srv1178769233:84 , srv1202863274:84 , srv1215231267:84 , srv1215488405:84 , srv1234356808:84 , srv1237247084:84 , srv1306537893:84 , srv1313591295:84 , srv1361416594:84 , srv138286760:84 , srv1385912435:84 , srv1418559955:84 , srv1420584872:84 , srv1424083629:84 , srv1482986893:84 , srv1489356575:84 , srv1489524304:84 , srv1568838532:84 , srv1586781093:84 , srv1591031286:84 , srv164236149:84 , srv1642384255:84 , srv1644637247:84 , srv1650849598:84 , srv1656478023:84 , srv1681504837:84 , srv1796491410:84 , srv1817154892:84 , srv1823234349:84 , srv1827287908:84 , srv1860304241:84 , srv1878205024:84 , srv1906993494:84 , srv1933729674:84 , srv2022691848:84 , srv2029282092:84 , srv2070466547:84 , srv207628480:84 , srv2078365404:84 , srv2084578546:84 , srv2104491461:84 , srv2128047223:84 , srv2134678610:84 , srv284761137:84 , srv291516538:84 , srv294275701:84 , srv305925176:84 , srv311497957:84 , srv337856239:84 , srv366408317:84 , srv390934416:84 , srv411500919:84 , srv422642211:84 , srv444488631:84 , srv444587770:84 , srv45441790:84 , srv459641236:84 , srv497377346:84 , srv527546080:84 , srv567421420:84 , srv637004545:84 , srv648335989:84 , srv682375124:84 , srv700489603:84 , srv709551057:84 , srv710729740:84 , srv729761158:84 , srv790389661:84 , srv809724039:84 , srv811638099:84 , srv827970284:84 , srv842693193:84 , srv853214541:84 , srv870278292:84 , srv900582069:84 , srv94716256:84 , srv991198069:84 , srv1445183641:85 , srv1480101368:85 , srv1542282687:85 , srv1947198261:85 , srv654566399:85 , srv764585564:85 , srv880413132:85 , srv1611941122:684 }
2024-01-27 08:53:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:17,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv311497957=62, srv809724039=89, srv2022691848=48, srv700489603=83, srv827970284=91, srv422642211=68, srv534546057=76, srv1306537893=14, srv567421420=77, srv138286760=17, srv366408317=64, srv729761158=86, srv1642384255=33, srv1215231267=10, srv337856239=63, srv207628480=51, srv1178769233=8, srv1424083629=21, srv811638099=90, srv1860304241=43, srv390934416=66, srv1313591295=15, srv709551057=84, srv1542282687=27, srv444488631=69, srv653839068=80, srv1611941122=31, srv284761137=58, srv1093007429=2, srv2078365404=52, srv880413132=95, srv224695347=57, srv1122149292=5, srv1489356575=25, srv1947198261=47, srv1480101368=23, srv1591031286=30, srv1666547544=37, srv2134678610=56, srv305925176=61, srv710729740=85, srv497377346=74, srv2104491461=54, srv1489524304=26, srv1817154892=40, srv648335989=79, srv1445183641=22, srv381893394=65, srv2084578546=53, srv527546080=75, srv2070466547=50, srv900582069=96, srv1215488405=11, srv291516538=59, srv94716256=98, srv1420584872=20, srv1123744245=7, srv930943369=97, srv164236149=32, srv1796491410=39, srv1656478023=36, srv682375124=82, srv2128047223=55, srv1823234349=41, srv482894036=73, srv459641236=72, srv637004545=78, srv853214541=93, srv1122734451=6, srv1094042986=3, srv1906993494=45, srv1361416594=16, srv1568838532=28, srv1586781093=29, srv1077595705=1, srv1827287908=42, srv1933729674=46, srv1202863274=9, srv764585564=87, srv1482986893=24, srv790389661=88, srv1030748844=0, srv2029282092=49, srv842693193=92, srv991198069=99, srv1644637247=34, srv1234356808=12, srv1650849598=35, srv1385912435=18, srv1113239706=4, srv870278292=94, srv1418559955=19, srv45441790=71, srv294275701=60, srv1878205024=44, srv654566399=81, srv411500919=67, srv1681504837=38, srv1237247084=13, srv444587770=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-27 08:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-27 08:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-27 08:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-27 08:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-27 08:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-27 08:53:17,715 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:17,715 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1666547544:83 , srv224695347:83 , srv381893394:83 , srv482894036:83 , srv534546057:83 , srv653839068:83 , srv930943369:83 , srv1030748844:84 , srv1077595705:84 , srv1093007429:84 , srv1094042986:84 , srv1113239706:84 , srv1122149292:84 , srv1122734451:84 , srv1123744245:84 , srv1178769233:84 , srv1202863274:84 , srv1215231267:84 , srv1215488405:84 , srv1234356808:84 , srv1237247084:84 , srv1306537893:84 , srv1313591295:84 , srv1361416594:84 , srv138286760:84 , srv1385912435:84 , srv1418559955:84 , srv1420584872:84 , srv1424083629:84 , srv1482986893:84 , srv1489356575:84 , srv1489524304:84 , srv1568838532:84 , srv1586781093:84 , srv1591031286:84 , srv164236149:84 , srv1642384255:84 , srv1644637247:84 , srv1650849598:84 , srv1656478023:84 , srv1681504837:84 , srv1796491410:84 , srv1817154892:84 , srv1823234349:84 , srv1827287908:84 , srv1860304241:84 , srv1878205024:84 , srv1906993494:84 , srv1933729674:84 , srv2022691848:84 , srv2029282092:84 , srv2070466547:84 , srv207628480:84 , srv2078365404:84 , srv2084578546:84 , srv2104491461:84 , srv2128047223:84 , srv2134678610:84 , srv284761137:84 , srv291516538:84 , srv294275701:84 , srv305925176:84 , srv311497957:84 , srv337856239:84 , srv366408317:84 , srv390934416:84 , srv411500919:84 , srv422642211:84 , srv444488631:84 , srv444587770:84 , srv45441790:84 , srv459641236:84 , srv497377346:84 , srv527546080:84 , srv567421420:84 , srv637004545:84 , srv648335989:84 , srv682375124:84 , srv700489603:84 , srv709551057:84 , srv710729740:84 , srv729761158:84 , srv790389661:84 , srv809724039:84 , srv811638099:84 , srv827970284:84 , srv842693193:84 , srv853214541:84 , srv870278292:84 , srv900582069:84 , srv94716256:84 , srv991198069:84 , srv1445183641:85 , srv1480101368:85 , srv1542282687:85 , srv1947198261:85 , srv654566399:85 , srv764585564:85 , srv880413132:85 , srv1611941122:684 }
2024-01-27 08:53:17,740 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=356 (was 344) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5689 (was 6620)
2024-01-27 08:53:17,748 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=356, ProcessCount=167, AvailableMemoryMB=5689
2024-01-27 08:53:17,748 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-27 08:53:17,749 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-27 08:53:17,760 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1149800491:84 , srv1208679766:84 , srv1255955164:84 , srv1289295567:84 , srv1302705476:84 , srv1425294029:84 , srv1474146454:84 , srv1519892597:84 , srv1550306202:84 , srv1582099538:84 , srv1614427722:84 , srv1626543540:84 , srv1743059272:84 , srv1879714763:84 , srv1960746149:84 , srv2002053641:84 , srv2010934713:84 , srv2088457093:84 , srv2106448961:84 , srv213263693:84 , srv232701454:84 , srv30624589:84 , srv451232263:84 , srv529016592:84 , srv614890171:84 , srv624929882:84 , srv854747067:84 , srv85558498:84 , srv935633956:84 , srv840017828:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-27 08:53:17,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:53:17,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv935633956=29, srv2088457093=17, srv1614427722=10, srv213263693=19, srv614890171=24, srv1626543540=11, srv840017828=26, srv232701454=20, srv30624589=21, srv1208679766=1, srv854747067=27, srv1960746149=14, srv624929882=25, srv1289295567=3, srv529016592=23, srv1149800491=0, srv1582099538=9, srv1519892597=7, srv1302705476=4, srv1879714763=13, srv1425294029=5, srv2010934713=16, srv1255955164=2, srv85558498=28, srv2002053641=15, srv2106448961=18, srv1474146454=6, srv1550306202=8, srv1743059272=12, srv451232263=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:53:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:53:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:53:17,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:53:17,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:53:17,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:53:17,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-27 08:53:17,790 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.033555898492733, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:53:17,790 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912298776804732, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.033555898492733, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-27 08:55:17,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6293991 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912298776804732 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:55:17,784 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1149800491:90 , srv1208679766:90 , srv1255955164:90 , srv1289295567:90 , srv1302705476:90 , srv1425294029:90 , srv1474146454:90 , srv1519892597:90 , srv1550306202:90 , srv1582099538:90 , srv1614427722:90 , srv1626543540:90 , srv1743059272:90 , srv1879714763:90 , srv1960746149:90 , srv2002053641:90 , srv2010934713:90 , srv2088457093:90 , srv2106448961:90 , srv213263693:90 , srv232701454:90 , srv30624589:90 , srv451232263:90 , srv529016592:90 , srv614890171:90 , srv624929882:90 , srv840017828:90 , srv854747067:90 , srv85558498:90 , srv935633956:90 }
2024-01-27 08:55:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-27 08:55:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv935633956=29, srv2088457093=17, srv1614427722=10, srv213263693=19, srv614890171=24, srv1626543540=11, srv840017828=26, srv232701454=20, srv30624589=21, srv1208679766=1, srv854747067=27, srv1960746149=14, srv624929882=25, srv1289295567=3, srv529016592=23, srv1149800491=0, srv1582099538=9, srv1519892597=7, srv1302705476=4, srv1879714763=13, srv1425294029=5, srv2010934713=16, srv1255955164=2, srv85558498=28, srv2002053641=15, srv2106448961=18, srv1474146454=6, srv1550306202=8, srv1743059272=12, srv451232263=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-27 08:55:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-27 08:55:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-27 08:55:17,807 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-27 08:55:17,807 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1149800491:90 , srv1208679766:90 , srv1255955164:90 , srv1289295567:90 , srv1302705476:90 , srv1425294029:90 , srv1474146454:90 , srv1519892597:90 , srv1550306202:90 , srv1582099538:90 , srv1614427722:90 , srv1626543540:90 , srv1743059272:90 , srv1879714763:90 , srv1960746149:90 , srv2002053641:90 , srv2010934713:90 , srv2088457093:90 , srv2106448961:90 , srv213263693:90 , srv232701454:90 , srv30624589:90 , srv451232263:90 , srv529016592:90 , srv614890171:90 , srv624929882:90 , srv840017828:90 , srv854747067:90 , srv85558498:90 , srv935633956:90 }
2024-01-27 08:55:17,826 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 356), ProcessCount=167 (was 167), AvailableMemoryMB=5057 (was 5689)