2023-10-24 14:53:25,378 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-24 14:53:25,693 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-24 14:53:25,797 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-24 14:53:25,872 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 14:53:25,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-24 14:53:25,896 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=171, AvailableMemoryMB=9846
2023-10-24 14:53:25,898 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 14:53:25,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-24 14:53:26,032 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009313066:84 , srv1013618480:84 , srv1015656936:84 , srv1036311193:84 , srv103704234:84 , srv103766458:84 , srv1055550638:84 , srv1091421539:84 , srv1095068288:84 , srv1100081934:84 , srv1116831725:84 , srv1128109988:84 , srv1147682501:84 , srv11500116:84 , srv1166604318:84 , srv1177268355:84 , srv1179874952:84 , srv1198123375:84 , srv1200018165:84 , srv1201760126:84 , srv1202465889:84 , srv1227241440:84 , srv128799455:84 , srv1292064373:84 , srv1320069726:84 , srv133704127:84 , srv137434231:84 , srv1380067186:84 , srv1406381702:84 , srv1432630921:84 , srv1491832189:84 , srv1513394940:84 , srv1526554690:84 , srv1573399260:84 , srv1590502824:84 , srv1593983627:84 , srv1633573621:84 , srv1669011664:84 , srv1672567772:84 , srv1700508269:84 , srv1726175515:84 , srv1727391802:84 , srv177733586:84 , srv1778907307:84 , srv1839916276:84 , srv1867285787:84 , srv1880169507:84 , srv1884079411:84 , srv1906631039:84 , srv1916799916:84 , srv1924057521:84 , srv1938497375:84 , srv1953361540:84 , srv1966516953:84 , srv1970001957:84 , srv199468868:84 , srv2015881820:84 , srv2041465081:84 , srv2054403300:84 , srv2084336221:84 , srv208735573:84 , srv2092444305:84 , srv2140321161:84 , srv247778712:84 , srv260990532:84 , srv272608147:84 , srv309234028:84 , srv329401413:84 , srv332293802:84 , srv375137517:84 , srv406521031:84 , srv409744253:84 , srv423791215:84 , srv457084074:84 , srv457201520:84 , srv460599297:84 , srv474014605:84 , srv49714296:84 , srv507127368:84 , srv533037248:84 , srv546918604:84 , srv552656839:84 , srv594331459:84 , srv627074878:84 , srv6418329:84 , srv64516468:84 , srv693311164:84 , srv757769211:84 , srv789439333:84 , srv792770831:84 , srv829337804:84 , srv845540683:84 , srv8634395:84 , srv875836022:84 , srv886245317:84 , srv900344831:84 , srv928894001:84 , srv985881980:84 , srv991520375:84 , srv1694105497:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-24 14:53:26,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:26,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1700508269=40, srv6418329=85, srv789439333=89, srv1013618480=1, srv406521031=71, srv49714296=78, srv1867285787=46, srv1924057521=51, srv1778907307=44, srv1938497375=52, srv985881980=98, srv594331459=83, srv1884079411=48, srv1015656936=2, srv1573399260=33, srv2015881820=57, srv457084074=74, srv2140321161=63, srv928894001=97, srv1406381702=28, srv309234028=67, srv1953361540=53, srv991520375=99, srv1590502824=34, srv1009313066=0, srv2092444305=62, srv11500116=13, srv693311164=87, srv460599297=76, srv2084336221=60, srv208735573=61, srv137434231=26, srv1669011664=37, srv457201520=75, srv1727391802=42, srv1906631039=49, srv1672567772=38, srv1633573621=36, srv1198123375=17, srv1491832189=30, srv1839916276=45, srv1593983627=35, srv1091421539=7, srv1227241440=21, srv1055550638=6, srv1916799916=50, srv103766458=5, srv177733586=43, srv1116831725=10, srv829337804=91, srv1432630921=29, srv552656839=82, srv1202465889=20, srv875836022=94, srv1177268355=15, srv247778712=64, srv375137517=70, srv1036311193=3, srv533037248=80, srv1880169507=47, srv260990532=65, srv1970001957=55, srv2041465081=58, srv1966516953=54, srv332293802=69, srv757769211=88, srv64516468=86, srv1292064373=23, srv546918604=81, srv199468868=56, srv886245317=95, srv128799455=22, srv272608147=66, srv1200018165=18, srv133704127=25, srv845540683=92, srv1526554690=32, srv1179874952=16, srv1166604318=14, srv1320069726=24, srv103704234=4, srv8634395=93, srv1380067186=27, srv423791215=73, srv2054403300=59, srv1128109988=11, srv1726175515=41, srv1100081934=9, srv409744253=72, srv1147682501=12, srv1513394940=31, srv1694105497=39, srv329401413=68, srv507127368=79, srv627074878=84, srv792770831=90, srv1095068288=8, srv900344831=96, srv1201760126=19, srv474014605=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:26,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:26,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:26,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:26,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:26,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:26,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:26,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:26,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:26,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:26,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:26,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:26,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:26,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:26,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:26,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:26,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:26,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:26,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:26,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 14:53:26,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 14:53:26,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 14:53:26,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 14:53:26,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 14:53:26,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 14:53:26,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 14:53:26,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 14:53:26,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 14:53:26,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 14:53:26,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 14:53:26,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 14:53:26,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 14:53:26,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 14:53:26,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 14:53:26,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 14:53:26,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 14:53:26,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 14:53:26,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 14:53:26,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 14:53:26,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 14:53:26,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 14:53:26,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 14:53:26,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 14:53:26,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 14:53:26,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 14:53:26,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:26,559 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 14:53:26,560 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 14:53:27,036 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 850 ms to try 5000 different iterations.  Found a solution that moves 4706 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17571448605117873. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039723134599020084, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05585173574816679, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5228888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039723134599020084, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17108333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23566666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:27,054 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013618480:82 , srv1055550638:82 , srv1573399260:82 , srv1593983627:83 , srv1633573621:83 , srv1970001957:83 , srv208735573:83 , srv406521031:83 , srv457084074:83 , srv507127368:83 , srv552656839:83 , srv789439333:83 , srv103766458:84 , srv1128109988:84 , srv1227241440:84 , srv128799455:84 , srv1727391802:84 , srv1839916276:84 , srv272608147:84 , srv329401413:84 , srv460599297:84 , srv792770831:84 , srv886245317:84 , srv1491832189:85 , srv1513394940:85 , srv1916799916:85 , srv1938497375:85 , srv1953361540:85 , srv1966516953:85 , srv199468868:85 , srv2084336221:85 , srv2092444305:85 , srv260990532:85 , srv546918604:85 , srv594331459:85 , srv757769211:85 , srv8634395:85 , srv991520375:85 , srv1015656936:86 , srv103704234:86 , srv1100081934:86 , srv1166604318:86 , srv1177268355:86 , srv1201760126:86 , srv1292064373:86 , srv1406381702:86 , srv1432630921:86 , srv1590502824:86 , srv1726175515:86 , srv177733586:86 , srv1867285787:86 , srv2015881820:86 , srv2054403300:86 , srv332293802:86 , srv375137517:86 , srv474014605:86 , srv693311164:86 , srv829337804:86 , srv900344831:86 , srv1009313066:87 , srv1091421539:87 , srv1116831725:87 , srv1198123375:87 , srv1200018165:87 , srv133704127:87 , srv1526554690:87 , srv1906631039:87 , srv247778712:87 , srv409744253:87 , srv533037248:87 , srv928894001:87 , srv1320069726:88 , srv137434231:88 , srv1884079411:88 , srv2140321161:88 , srv627074878:88 , srv64516468:88 , srv1036311193:89 , srv1095068288:89 , srv1179874952:89 , srv1202465889:89 , srv1669011664:89 , srv423791215:89 , srv49714296:89 , srv6418329:89 , srv845540683:89 , srv1147682501:90 , srv1672567772:90 , srv2041465081:90 , srv875836022:90 , srv985881980:90 , srv11500116:91 , srv1700508269:91 , srv1778907307:91 , srv309234028:91 , srv1880169507:92 , srv1924057521:92 , srv1380067186:94 , srv457201520:94 , srv1694105497:443 }
2023-10-24 14:53:27,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:27,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1700508269=40, srv6418329=85, srv789439333=89, srv1013618480=1, srv406521031=71, srv49714296=78, srv1867285787=46, srv1924057521=51, srv1778907307=44, srv1938497375=52, srv985881980=98, srv594331459=83, srv1884079411=48, srv1015656936=2, srv1573399260=33, srv2015881820=57, srv457084074=74, srv2140321161=63, srv928894001=97, srv1406381702=28, srv309234028=67, srv1953361540=53, srv991520375=99, srv1590502824=34, srv1009313066=0, srv2092444305=62, srv11500116=13, srv693311164=87, srv460599297=76, srv2084336221=60, srv208735573=61, srv137434231=26, srv1669011664=37, srv457201520=75, srv1727391802=42, srv1906631039=49, srv1672567772=38, srv1633573621=36, srv1198123375=17, srv1491832189=30, srv1839916276=45, srv1593983627=35, srv1091421539=7, srv1227241440=21, srv1055550638=6, srv1916799916=50, srv103766458=5, srv177733586=43, srv1116831725=10, srv829337804=91, srv1432630921=29, srv552656839=82, srv1202465889=20, srv875836022=94, srv1177268355=15, srv247778712=64, srv375137517=70, srv1036311193=3, srv533037248=80, srv1880169507=47, srv260990532=65, srv1970001957=55, srv2041465081=58, srv1966516953=54, srv332293802=69, srv757769211=88, srv64516468=86, srv1292064373=23, srv546918604=81, srv199468868=56, srv886245317=95, srv128799455=22, srv272608147=66, srv1200018165=18, srv133704127=25, srv845540683=92, srv1526554690=32, srv1179874952=16, srv1166604318=14, srv1320069726=24, srv103704234=4, srv8634395=93, srv1380067186=27, srv423791215=73, srv2054403300=59, srv1128109988=11, srv1726175515=41, srv1100081934=9, srv409744253=72, srv1147682501=12, srv1513394940=31, srv1694105497=39, srv329401413=68, srv507127368=79, srv627074878=84, srv792770831=90, srv1095068288=8, srv900344831=96, srv1201760126=19, srv474014605=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:27,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:27,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:27,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:27,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:27,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:27,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:27,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:27,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:27,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:27,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:27,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:27,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:27,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:27,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:27,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 14:53:27,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 14:53:27,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 14:53:27,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 14:53:27,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 14:53:27,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 14:53:27,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 14:53:27,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 14:53:27,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 14:53:27,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 14:53:27,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039723134599020084, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05585173574816679, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039723134599020084, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17108333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23566666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:27,224 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 14:53:27,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17568153393487906, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039723134599020084, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05585173574816679, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039723134599020084, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17108333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23566666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 14:53:27,468 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 353 ms to try 5000 different iterations.  Found a solution that moves 2602 regions; Going from a computed imbalance of 0.17568153393487906 to a new imbalance of 0.015760826989048817. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02061530128843305); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033558164324305036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2891111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02061530128843305); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:27,478 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1778907307:78 , srv457201520:78 , srv1380067186:79 , srv1672567772:80 , srv1036311193:81 , srv845540683:81 , srv1095068288:82 , srv11500116:82 , srv1924057521:82 , srv409744253:82 , srv6418329:82 , srv1320069726:83 , srv1669011664:83 , srv64516468:83 , srv875836022:83 , srv1147682501:84 , srv1179874952:84 , srv1202465889:84 , srv133704127:84 , srv1884079411:84 , srv2041465081:84 , srv375137517:84 , srv423791215:84 , srv627074878:84 , srv900344831:84 , srv985881980:84 , srv1009313066:85 , srv1091421539:85 , srv1116831725:85 , srv1166604318:85 , srv137434231:85 , srv1700508269:85 , srv177733586:85 , srv1867285787:85 , srv1880169507:85 , srv2054403300:85 , srv2140321161:85 , srv247778712:85 , srv309234028:85 , srv474014605:85 , srv594331459:85 , srv8634395:85 , srv103704234:86 , srv1177268355:86 , srv1201760126:86 , srv1513394940:86 , srv1526554690:86 , srv1839916276:86 , srv1906631039:86 , srv1916799916:86 , srv1938497375:86 , srv1953361540:86 , srv2015881820:86 , srv332293802:86 , srv49714296:86 , srv546918604:86 , srv693311164:86 , srv928894001:86 , srv1015656936:87 , srv103766458:87 , srv1128109988:87 , srv1200018165:87 , srv128799455:87 , srv1292064373:87 , srv1406381702:87 , srv1432630921:87 , srv1491832189:87 , srv1590502824:87 , srv1727391802:87 , srv1970001957:87 , srv272608147:87 , srv329401413:87 , srv457084074:87 , srv460599297:87 , srv533037248:87 , srv552656839:87 , srv991520375:87 , srv1055550638:88 , srv1100081934:88 , srv1198123375:88 , srv1227241440:88 , srv1633573621:88 , srv1966516953:88 , srv199468868:88 , srv208735573:88 , srv2092444305:88 , srv789439333:88 , srv1593983627:89 , srv1726175515:89 , srv2084336221:89 , srv260990532:89 , srv406521031:89 , srv757769211:89 , srv792770831:89 , srv829337804:89 , srv886245317:89 , srv1573399260:90 , srv1013618480:91 , srv507127368:92 , srv1694105497:514 }
2023-10-24 14:53:27,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:27,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1700508269=40, srv6418329=85, srv789439333=89, srv1013618480=1, srv406521031=71, srv49714296=78, srv1867285787=46, srv1924057521=51, srv1778907307=44, srv1938497375=52, srv985881980=98, srv594331459=83, srv1884079411=48, srv1015656936=2, srv1573399260=33, srv2015881820=57, srv457084074=74, srv2140321161=63, srv928894001=97, srv1406381702=28, srv309234028=67, srv1953361540=53, srv991520375=99, srv1590502824=34, srv1009313066=0, srv2092444305=62, srv11500116=13, srv693311164=87, srv460599297=76, srv2084336221=60, srv208735573=61, srv137434231=26, srv1669011664=37, srv457201520=75, srv1727391802=42, srv1906631039=49, srv1672567772=38, srv1633573621=36, srv1198123375=17, srv1491832189=30, srv1839916276=45, srv1593983627=35, srv1091421539=7, srv1227241440=21, srv1055550638=6, srv1916799916=50, srv103766458=5, srv177733586=43, srv1116831725=10, srv829337804=91, srv1432630921=29, srv552656839=82, srv1202465889=20, srv875836022=94, srv1177268355=15, srv247778712=64, srv375137517=70, srv1036311193=3, srv533037248=80, srv1880169507=47, srv260990532=65, srv1970001957=55, srv2041465081=58, srv1966516953=54, srv332293802=69, srv757769211=88, srv64516468=86, srv1292064373=23, srv546918604=81, srv199468868=56, srv886245317=95, srv128799455=22, srv272608147=66, srv1200018165=18, srv133704127=25, srv845540683=92, srv1526554690=32, srv1179874952=16, srv1166604318=14, srv1320069726=24, srv103704234=4, srv8634395=93, srv1380067186=27, srv423791215=73, srv2054403300=59, srv1128109988=11, srv1726175515=41, srv1100081934=9, srv409744253=72, srv1147682501=12, srv1513394940=31, srv1694105497=39, srv329401413=68, srv507127368=79, srv627074878=84, srv792770831=90, srv1095068288=8, srv900344831=96, srv1201760126=19, srv474014605=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:27,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:27,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 14:53:27,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 14:53:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 14:53:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 14:53:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 14:53:27,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 14:53:27,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 14:53:27,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 14:53:27,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 14:53:27,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 14:53:27,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02061530128843305); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033558164324305036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02061530128843305); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:27,619 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 14:53:27,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01574260739563364, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02061530128843305); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033558164324305036, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02061530128843305); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 14:53:27,875 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 352 ms to try 5000 different iterations.  Found a solution that moves 1013 regions; Going from a computed imbalance of 0.01574260739563364 to a new imbalance of 7.904409251973661E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005665577237325316); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.11255555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005665577237325316); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:27,877 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv507127368:81 , srv829337804:81 , srv1198123375:82 , srv1700508269:82 , srv1880169507:82 , srv309234028:82 , srv1100081934:83 , srv1147682501:83 , srv1726175515:83 , srv533037248:83 , srv757769211:83 , srv11500116:84 , srv1200018165:84 , srv1202465889:84 , srv1292064373:84 , srv137434231:84 , srv1406381702:84 , srv1526554690:84 , srv1590502824:84 , srv1924057521:84 , srv2041465081:84 , srv2084336221:84 , srv2140321161:84 , srv260990532:84 , srv49714296:84 , srv1013618480:85 , srv1015656936:85 , srv103704234:85 , srv1116831725:85 , srv1177268355:85 , srv1179874952:85 , srv1201760126:85 , srv1227241440:85 , srv1380067186:85 , srv1432630921:85 , srv1593983627:85 , srv1867285787:85 , srv1884079411:85 , srv1966516953:85 , srv199468868:85 , srv2015881820:85 , srv332293802:85 , srv423791215:85 , srv457201520:85 , srv460599297:85 , srv64516468:85 , srv693311164:85 , srv792770831:85 , srv875836022:85 , srv886245317:85 , srv928894001:85 , srv985881980:85 , srv1009313066:86 , srv1091421539:86 , srv1095068288:86 , srv1128109988:86 , srv1166604318:86 , srv1491832189:86 , srv1513394940:86 , srv1573399260:86 , srv1669011664:86 , srv1727391802:86 , srv1906631039:86 , srv1938497375:86 , srv1953361540:86 , srv208735573:86 , srv2092444305:86 , srv272608147:86 , srv406521031:86 , srv474014605:86 , srv627074878:86 , srv6418329:86 , srv789439333:86 , srv991520375:86 , srv1036311193:87 , srv103766458:87 , srv1055550638:87 , srv128799455:87 , srv1320069726:87 , srv133704127:87 , srv1633573621:87 , srv1672567772:87 , srv177733586:87 , srv1916799916:87 , srv2054403300:87 , srv247778712:87 , srv329401413:87 , srv375137517:87 , srv457084074:87 , srv552656839:87 , srv594331459:87 , srv8634395:87 , srv900344831:87 , srv1778907307:88 , srv1839916276:88 , srv1970001957:88 , srv409744253:88 , srv546918604:88 , srv845540683:88 , srv1694105497:551 }
2023-10-24 14:53:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1700508269=40, srv6418329=85, srv789439333=89, srv1013618480=1, srv406521031=71, srv49714296=78, srv1867285787=46, srv1924057521=51, srv1778907307=44, srv1938497375=52, srv985881980=98, srv594331459=83, srv1884079411=48, srv1015656936=2, srv1573399260=33, srv2015881820=57, srv457084074=74, srv2140321161=63, srv928894001=97, srv1406381702=28, srv309234028=67, srv1953361540=53, srv991520375=99, srv1590502824=34, srv1009313066=0, srv2092444305=62, srv11500116=13, srv693311164=87, srv460599297=76, srv2084336221=60, srv208735573=61, srv137434231=26, srv1669011664=37, srv457201520=75, srv1727391802=42, srv1906631039=49, srv1672567772=38, srv1633573621=36, srv1198123375=17, srv1491832189=30, srv1839916276=45, srv1593983627=35, srv1091421539=7, srv1227241440=21, srv1055550638=6, srv1916799916=50, srv103766458=5, srv177733586=43, srv1116831725=10, srv829337804=91, srv1432630921=29, srv552656839=82, srv1202465889=20, srv875836022=94, srv1177268355=15, srv247778712=64, srv375137517=70, srv1036311193=3, srv533037248=80, srv1880169507=47, srv260990532=65, srv1970001957=55, srv2041465081=58, srv1966516953=54, srv332293802=69, srv757769211=88, srv64516468=86, srv1292064373=23, srv546918604=81, srv199468868=56, srv886245317=95, srv128799455=22, srv272608147=66, srv1200018165=18, srv133704127=25, srv845540683=92, srv1526554690=32, srv1179874952=16, srv1166604318=14, srv1320069726=24, srv103704234=4, srv8634395=93, srv1380067186=27, srv423791215=73, srv2054403300=59, srv1128109988=11, srv1726175515=41, srv1100081934=9, srv409744253=72, srv1147682501=12, srv1513394940=31, srv1694105497=39, srv329401413=68, srv507127368=79, srv627074878=84, srv792770831=90, srv1095068288=8, srv900344831=96, srv1201760126=19, srv474014605=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:27,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:27,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 14:53:27,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 14:53:27,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 14:53:27,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 14:53:27,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 14:53:27,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 14:53:28,001 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005665577237325316); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005665577237325316); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:28,001 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 14:53:28,001 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.833477475918411E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005665577237325316); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009628334541246444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005665577237325316); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 14:53:28,359 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 451 ms to try 5000 different iterations.  Found a solution that moves 263 regions; Going from a computed imbalance of 7.833477475918411E-4 to a new imbalance of 3.675693055379891E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.029222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:28,360 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1633573621:83 , srv177733586:83 , srv1880169507:83 , srv1970001957:83 , srv247778712:83 , srv49714296:83 , srv546918604:83 , srv845540683:83 , srv985881980:83 , srv1013618480:84 , srv1015656936:84 , srv1091421539:84 , srv1177268355:84 , srv1179874952:84 , srv1200018165:84 , srv1201760126:84 , srv128799455:84 , srv1292064373:84 , srv1320069726:84 , srv133704127:84 , srv1380067186:84 , srv1432630921:84 , srv1513394940:84 , srv1573399260:84 , srv1669011664:84 , srv1700508269:84 , srv1726175515:84 , srv1839916276:84 , srv1906631039:84 , srv1916799916:84 , srv1924057521:84 , srv1966516953:84 , srv199468868:84 , srv2015881820:84 , srv2041465081:84 , srv2054403300:84 , srv2084336221:84 , srv2092444305:84 , srv260990532:84 , srv329401413:84 , srv406521031:84 , srv423791215:84 , srv627074878:84 , srv792770831:84 , srv886245317:84 , srv928894001:84 , srv991520375:84 , srv1009313066:85 , srv1036311193:85 , srv103704234:85 , srv103766458:85 , srv1055550638:85 , srv1095068288:85 , srv1100081934:85 , srv1116831725:85 , srv1128109988:85 , srv1147682501:85 , srv11500116:85 , srv1166604318:85 , srv1198123375:85 , srv1202465889:85 , srv1227241440:85 , srv1406381702:85 , srv1491832189:85 , srv1526554690:85 , srv1593983627:85 , srv1672567772:85 , srv1727391802:85 , srv1778907307:85 , srv1884079411:85 , srv1938497375:85 , srv1953361540:85 , srv208735573:85 , srv2140321161:85 , srv272608147:85 , srv309234028:85 , srv332293802:85 , srv375137517:85 , srv409744253:85 , srv457084074:85 , srv457201520:85 , srv474014605:85 , srv507127368:85 , srv533037248:85 , srv552656839:85 , srv594331459:85 , srv6418329:85 , srv693311164:85 , srv789439333:85 , srv8634395:85 , srv875836022:85 , srv900344831:85 , srv137434231:86 , srv1590502824:86 , srv1867285787:86 , srv460599297:86 , srv64516468:86 , srv757769211:86 , srv829337804:86 , srv1694105497:634 }
2023-10-24 14:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1700508269=40, srv6418329=85, srv789439333=89, srv1013618480=1, srv406521031=71, srv49714296=78, srv1867285787=46, srv1924057521=51, srv1778907307=44, srv1938497375=52, srv985881980=98, srv594331459=83, srv1884079411=48, srv1015656936=2, srv1573399260=33, srv2015881820=57, srv457084074=74, srv2140321161=63, srv928894001=97, srv1406381702=28, srv309234028=67, srv1953361540=53, srv991520375=99, srv1590502824=34, srv1009313066=0, srv2092444305=62, srv11500116=13, srv693311164=87, srv460599297=76, srv2084336221=60, srv208735573=61, srv137434231=26, srv1669011664=37, srv457201520=75, srv1727391802=42, srv1906631039=49, srv1672567772=38, srv1633573621=36, srv1198123375=17, srv1491832189=30, srv1839916276=45, srv1593983627=35, srv1091421539=7, srv1227241440=21, srv1055550638=6, srv1916799916=50, srv103766458=5, srv177733586=43, srv1116831725=10, srv829337804=91, srv1432630921=29, srv552656839=82, srv1202465889=20, srv875836022=94, srv1177268355=15, srv247778712=64, srv375137517=70, srv1036311193=3, srv533037248=80, srv1880169507=47, srv260990532=65, srv1970001957=55, srv2041465081=58, srv1966516953=54, srv332293802=69, srv757769211=88, srv64516468=86, srv1292064373=23, srv546918604=81, srv199468868=56, srv886245317=95, srv128799455=22, srv272608147=66, srv1200018165=18, srv133704127=25, srv845540683=92, srv1526554690=32, srv1179874952=16, srv1166604318=14, srv1320069726=24, srv103704234=4, srv8634395=93, srv1380067186=27, srv423791215=73, srv2054403300=59, srv1128109988=11, srv1726175515=41, srv1100081934=9, srv409744253=72, srv1147682501=12, srv1513394940=31, srv1694105497=39, srv329401413=68, srv507127368=79, srv627074878=84, srv792770831=90, srv1095068288=8, srv900344831=96, srv1201760126=19, srv474014605=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:28,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:28,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 14:53:28,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 14:53:28,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 14:53:28,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 14:53:28,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 14:53:28,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 14:53:28,484 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:28,485 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 14:53:28,485 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.491536519323322E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 14:53:28,741 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 353 ms to try 5000 different iterations.  Found a solution that moves 38 regions; Going from a computed imbalance of 3.491536519323322E-5 to a new imbalance of 6.664067359347632E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.004222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:28,742 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1009313066:83 , srv103766458:83 , srv137434231:83 , srv1491832189:83 , srv1590502824:83 , srv1906631039:83 , srv2092444305:83 , srv309234028:83 , srv757769211:83 , srv875836022:83 , srv1013618480:84 , srv1015656936:84 , srv1036311193:84 , srv103704234:84 , srv1055550638:84 , srv1091421539:84 , srv1095068288:84 , srv1100081934:84 , srv1116831725:84 , srv1128109988:84 , srv1147682501:84 , srv11500116:84 , srv1166604318:84 , srv1179874952:84 , srv1198123375:84 , srv1200018165:84 , srv1202465889:84 , srv1227241440:84 , srv128799455:84 , srv1320069726:84 , srv133704127:84 , srv1380067186:84 , srv1406381702:84 , srv1432630921:84 , srv1526554690:84 , srv1573399260:84 , srv1593983627:84 , srv1669011664:84 , srv1672567772:84 , srv1700508269:84 , srv1726175515:84 , srv1727391802:84 , srv1778907307:84 , srv1839916276:84 , srv1867285787:84 , srv1880169507:84 , srv1884079411:84 , srv1916799916:84 , srv1924057521:84 , srv1938497375:84 , srv1953361540:84 , srv1966516953:84 , srv199468868:84 , srv2041465081:84 , srv2054403300:84 , srv2084336221:84 , srv208735573:84 , srv2140321161:84 , srv247778712:84 , srv260990532:84 , srv272608147:84 , srv329401413:84 , srv332293802:84 , srv375137517:84 , srv406521031:84 , srv409744253:84 , srv423791215:84 , srv457084074:84 , srv457201520:84 , srv460599297:84 , srv474014605:84 , srv49714296:84 , srv533037248:84 , srv546918604:84 , srv552656839:84 , srv594331459:84 , srv627074878:84 , srv6418329:84 , srv64516468:84 , srv693311164:84 , srv789439333:84 , srv792770831:84 , srv829337804:84 , srv8634395:84 , srv886245317:84 , srv900344831:84 , srv928894001:84 , srv985881980:84 , srv991520375:84 , srv1177268355:85 , srv1201760126:85 , srv1292064373:85 , srv1513394940:85 , srv1633573621:85 , srv177733586:85 , srv1970001957:85 , srv2015881820:85 , srv507127368:85 , srv845540683:85 , srv1694105497:684 }
2023-10-24 14:53:28,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:28,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1700508269=40, srv6418329=85, srv789439333=89, srv1013618480=1, srv406521031=71, srv49714296=78, srv1867285787=46, srv1924057521=51, srv1778907307=44, srv1938497375=52, srv985881980=98, srv594331459=83, srv1884079411=48, srv1015656936=2, srv1573399260=33, srv2015881820=57, srv457084074=74, srv2140321161=63, srv928894001=97, srv1406381702=28, srv309234028=67, srv1953361540=53, srv991520375=99, srv1590502824=34, srv1009313066=0, srv2092444305=62, srv11500116=13, srv693311164=87, srv460599297=76, srv2084336221=60, srv208735573=61, srv137434231=26, srv1669011664=37, srv457201520=75, srv1727391802=42, srv1906631039=49, srv1672567772=38, srv1633573621=36, srv1198123375=17, srv1491832189=30, srv1839916276=45, srv1593983627=35, srv1091421539=7, srv1227241440=21, srv1055550638=6, srv1916799916=50, srv103766458=5, srv177733586=43, srv1116831725=10, srv829337804=91, srv1432630921=29, srv552656839=82, srv1202465889=20, srv875836022=94, srv1177268355=15, srv247778712=64, srv375137517=70, srv1036311193=3, srv533037248=80, srv1880169507=47, srv260990532=65, srv1970001957=55, srv2041465081=58, srv1966516953=54, srv332293802=69, srv757769211=88, srv64516468=86, srv1292064373=23, srv546918604=81, srv199468868=56, srv886245317=95, srv128799455=22, srv272608147=66, srv1200018165=18, srv133704127=25, srv845540683=92, srv1526554690=32, srv1179874952=16, srv1166604318=14, srv1320069726=24, srv103704234=4, srv8634395=93, srv1380067186=27, srv423791215=73, srv2054403300=59, srv1128109988=11, srv1726175515=41, srv1100081934=9, srv409744253=72, srv1147682501=12, srv1513394940=31, srv1694105497=39, srv329401413=68, srv507127368=79, srv627074878=84, srv792770831=90, srv1095068288=8, srv900344831=96, srv1201760126=19, srv474014605=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:28,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 14:53:28,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 14:53:28,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 14:53:28,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 14:53:28,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 14:53:28,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 14:53:28,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:28,868 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1009313066:83 , srv103766458:83 , srv137434231:83 , srv1491832189:83 , srv1590502824:83 , srv1906631039:83 , srv2092444305:83 , srv309234028:83 , srv757769211:83 , srv875836022:83 , srv1013618480:84 , srv1015656936:84 , srv1036311193:84 , srv103704234:84 , srv1055550638:84 , srv1091421539:84 , srv1095068288:84 , srv1100081934:84 , srv1116831725:84 , srv1128109988:84 , srv1147682501:84 , srv11500116:84 , srv1166604318:84 , srv1179874952:84 , srv1198123375:84 , srv1200018165:84 , srv1202465889:84 , srv1227241440:84 , srv128799455:84 , srv1320069726:84 , srv133704127:84 , srv1380067186:84 , srv1406381702:84 , srv1432630921:84 , srv1526554690:84 , srv1573399260:84 , srv1593983627:84 , srv1669011664:84 , srv1672567772:84 , srv1700508269:84 , srv1726175515:84 , srv1727391802:84 , srv1778907307:84 , srv1839916276:84 , srv1867285787:84 , srv1880169507:84 , srv1884079411:84 , srv1916799916:84 , srv1924057521:84 , srv1938497375:84 , srv1953361540:84 , srv1966516953:84 , srv199468868:84 , srv2041465081:84 , srv2054403300:84 , srv2084336221:84 , srv208735573:84 , srv2140321161:84 , srv247778712:84 , srv260990532:84 , srv272608147:84 , srv329401413:84 , srv332293802:84 , srv375137517:84 , srv406521031:84 , srv409744253:84 , srv423791215:84 , srv457084074:84 , srv457201520:84 , srv460599297:84 , srv474014605:84 , srv49714296:84 , srv533037248:84 , srv546918604:84 , srv552656839:84 , srv594331459:84 , srv627074878:84 , srv6418329:84 , srv64516468:84 , srv693311164:84 , srv789439333:84 , srv792770831:84 , srv829337804:84 , srv8634395:84 , srv886245317:84 , srv900344831:84 , srv928894001:84 , srv985881980:84 , srv991520375:84 , srv1177268355:85 , srv1201760126:85 , srv1292064373:85 , srv1513394940:85 , srv1633573621:85 , srv177733586:85 , srv1970001957:85 , srv2015881820:85 , srv507127368:85 , srv845540683:85 , srv1694105497:684 }
2023-10-24 14:53:28,896 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 327), ProcessCount=171 (was 171), AvailableMemoryMB=9351 (was 9846)
2023-10-24 14:53:28,903 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=171, AvailableMemoryMB=9351
2023-10-24 14:53:28,903 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 14:53:28,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-24 14:53:28,915 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004659471:84 , srv1187574607:84 , srv1339702862:84 , srv1372689720:84 , srv1402654655:84 , srv1662745307:84 , srv1700782553:84 , srv170690877:84 , srv1707205109:84 , srv1718616138:84 , srv173140845:84 , srv175037215:84 , srv1803782593:84 , srv1966336511:84 , srv2008257938:84 , srv2118673092:84 , srv257682757:84 , srv317267920:84 , srv443651894:84 , srv487173482:84 , srv516511733:84 , srv584345449:84 , srv621108059:84 , srv694491588:84 , srv751270301:84 , srv884375722:84 , srv900857262:84 , srv927376720:84 , srv983142887:84 , srv1670239023:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-24 14:53:28,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:53:28,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv173140845=11, srv900857262=27, srv487173482=20, srv884375722=26, srv1402654655=4, srv175037215=12, srv621108059=23, srv1700782553=7, srv1339702862=2, srv1372689720=3, srv1187574607=1, srv1718616138=10, srv751270301=25, srv1803782593=13, srv2118673092=16, srv170690877=8, srv927376720=28, srv257682757=17, srv1004659471=0, srv1707205109=9, srv694491588=24, srv983142887=29, srv1670239023=6, srv516511733=21, srv317267920=18, srv1966336511=14, srv584345449=22, srv443651894=19, srv2008257938=15, srv1662745307=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:53:28,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:53:28,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:53:28,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-24 14:53:28,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.101859070389168, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:53:28,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912513997869071, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.101859070389168, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-24 14:55:28,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5611563 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912513997869071 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:55:28,944 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1004659471:90 , srv1187574607:90 , srv1339702862:90 , srv1372689720:90 , srv1402654655:90 , srv1662745307:90 , srv1670239023:90 , srv1700782553:90 , srv170690877:90 , srv1707205109:90 , srv1718616138:90 , srv173140845:90 , srv175037215:90 , srv1803782593:90 , srv1966336511:90 , srv2008257938:90 , srv2118673092:90 , srv257682757:90 , srv317267920:90 , srv443651894:90 , srv487173482:90 , srv516511733:90 , srv584345449:90 , srv621108059:90 , srv694491588:90 , srv751270301:90 , srv884375722:90 , srv900857262:90 , srv927376720:90 , srv983142887:90 }
2023-10-24 14:55:28,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 14:55:28,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv173140845=11, srv900857262=27, srv487173482=20, srv884375722=26, srv1402654655=4, srv175037215=12, srv621108059=23, srv1700782553=7, srv1339702862=2, srv1372689720=3, srv1187574607=1, srv1718616138=10, srv751270301=25, srv1803782593=13, srv2118673092=16, srv170690877=8, srv927376720=28, srv257682757=17, srv1004659471=0, srv1707205109=9, srv694491588=24, srv983142887=29, srv1670239023=6, srv516511733=21, srv317267920=18, srv1966336511=14, srv584345449=22, srv443651894=19, srv2008257938=15, srv1662745307=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 14:55:28,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 14:55:28,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-24 14:55:28,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 14:55:28,962 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1004659471:90 , srv1187574607:90 , srv1339702862:90 , srv1372689720:90 , srv1402654655:90 , srv1662745307:90 , srv1670239023:90 , srv1700782553:90 , srv170690877:90 , srv1707205109:90 , srv1718616138:90 , srv173140845:90 , srv175037215:90 , srv1803782593:90 , srv1966336511:90 , srv2008257938:90 , srv2118673092:90 , srv257682757:90 , srv317267920:90 , srv443651894:90 , srv487173482:90 , srv516511733:90 , srv584345449:90 , srv621108059:90 , srv694491588:90 , srv751270301:90 , srv884375722:90 , srv900857262:90 , srv927376720:90 , srv983142887:90 }
2023-10-24 14:55:28,974 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 327), ProcessCount=168 (was 171), AvailableMemoryMB=9049 (was 9351)