2023-11-14 20:55:21,040 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-14 20:55:21,342 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-14 20:55:21,442 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-14 20:55:21,508 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-14 20:55:21,516 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-14 20:55:21,528 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=98, ProcessCount=171, AvailableMemoryMB=2186
2023-11-14 20:55:21,530 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-14 20:55:21,530 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-14 20:55:21,657 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv101305809:84 , srv1017907871:84 , srv1021753669:84 , srv1060446261:84 , srv1069973151:84 , srv1137667307:84 , srv1178473805:84 , srv1197174159:84 , srv1251057778:84 , srv1282148401:84 , srv1294114673:84 , srv1300943303:84 , srv1308866756:84 , srv1312556128:84 , srv1334014991:84 , srv1335817973:84 , srv1345139920:84 , srv1350775994:84 , srv135754154:84 , srv1363284916:84 , srv1369673550:84 , srv1373726040:84 , srv1377198638:84 , srv1387471703:84 , srv142091984:84 , srv1421380987:84 , srv1428912897:84 , srv1471582509:84 , srv1473059040:84 , srv1499428320:84 , srv150797013:84 , srv1521815709:84 , srv1529423655:84 , srv1536374155:84 , srv1536578974:84 , srv1547309540:84 , srv1554235203:84 , srv1554694578:84 , srv1567112313:84 , srv1569431132:84 , srv1574774873:84 , srv1598543632:84 , srv1599898912:84 , srv1603618195:84 , srv160861401:84 , srv1622888762:84 , srv163490349:84 , srv1642951082:84 , srv1647654943:84 , srv1658150069:84 , srv1693649092:84 , srv1713203076:84 , srv17228116:84 , srv1724222510:84 , srv1810437367:84 , srv1825328728:84 , srv1855356128:84 , srv1937598952:84 , srv1959710049:84 , srv1963775912:84 , srv1966803559:84 , srv2037332816:84 , srv2067238319:84 , srv2092220594:84 , srv2107042168:84 , srv211968071:84 , srv2122642767:84 , srv2136603560:84 , srv225837847:84 , srv235236073:84 , srv324297249:84 , srv32632263:84 , srv328668052:84 , srv361047516:84 , srv401440726:84 , srv411565887:84 , srv414248210:84 , srv415093929:84 , srv476830977:84 , srv481673614:84 , srv537739534:84 , srv54040397:84 , srv554642986:84 , srv582471953:84 , srv614341047:84 , srv618687472:84 , srv654634220:84 , srv662846227:84 , srv689794248:84 , srv758077035:84 , srv780286014:84 , srv81351893:84 , srv8159865:84 , srv826340631:84 , srv829758847:84 , srv843188665:84 , srv918467401:84 , srv98220513:84 , srv986199922:84 , srv1932571288:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-14 20:55:21,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:55:21,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1574774873=40, srv17228116=52, srv614341047=85, srv1312556128=13, srv1963775912=60, srv1471582509=27, srv1335817973=15, srv1622888762=45, srv1724222510=53, srv1473059040=28, srv1932571288=57, srv163490349=46, srv1599898912=42, srv1713203076=51, srv1642951082=47, srv1069973151=4, srv537739534=81, srv1197174159=7, srv1855356128=56, srv829758847=95, srv1536578974=34, srv1060446261=3, srv1499428320=29, srv918467401=97, srv1825328728=55, srv324297249=71, srv476830977=79, srv1294114673=10, srv662846227=88, srv758077035=90, srv401440726=75, srv2092220594=64, srv1554694578=37, srv986199922=99, srv1373726040=21, srv225837847=69, srv235236073=70, srv1137667307=5, srv135754154=18, srv81351893=92, srv1529423655=32, srv689794248=89, srv1959710049=59, srv1251057778=8, srv411565887=76, srv160861401=44, srv414248210=77, srv98220513=98, srv2067238319=63, srv1387471703=23, srv1567112313=38, srv150797013=30, srv1937598952=58, srv1369673550=20, srv1377198638=22, srv54040397=82, srv101305809=0, srv1350775994=17, srv1547309540=35, srv328668052=73, srv1178473805=6, srv1810437367=54, srv32632263=72, srv361047516=74, srv1421380987=25, srv1536374155=33, srv1966803559=61, srv1345139920=16, srv780286014=91, srv843188665=96, srv1647654943=48, srv481673614=80, srv1428912897=26, srv1569431132=39, srv142091984=24, srv654634220=87, srv1021753669=2, srv415093929=78, srv1334014991=14, srv1603618195=43, srv1308866756=12, srv2136603560=68, srv1017907871=1, srv826340631=94, srv1693649092=50, srv1598543632=41, srv1658150069=49, srv582471953=84, srv2107042168=65, srv8159865=93, srv2122642767=67, srv554642986=83, srv1363284916=19, srv2037332816=62, srv1554235203=36, srv1282148401=9, srv211968071=66, srv1300943303=11, srv618687472=86, srv1521815709=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:55:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:55:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:55:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-14 20:55:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-14 20:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-14 20:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-14 20:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-14 20:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-14 20:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-14 20:55:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-14 20:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-14 20:55:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-14 20:55:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-14 20:55:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-14 20:55:21,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-14 20:55:21,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-14 20:55:21,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-14 20:55:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-14 20:55:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-14 20:55:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-14 20:55:21,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-14 20:55:21,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:21,926 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-14 20:55:21,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-14 20:55:22,270 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 4668 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17762174087838922. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03972972663448842, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05460808226544231, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5186666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03972972663448842, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.173, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:22,293 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2037332816:82 , srv211968071:82 , srv324297249:82 , srv1060446261:83 , srv1369673550:83 , srv1499428320:83 , srv1693649092:83 , srv2122642767:83 , srv361047516:83 , srv758077035:83 , srv1021753669:84 , srv135754154:84 , srv1598543632:84 , srv160861401:84 , srv1642951082:84 , srv1810437367:84 , srv1959710049:84 , srv1963775912:84 , srv2107042168:84 , srv235236073:84 , srv328668052:84 , srv826340631:84 , srv1294114673:85 , srv142091984:85 , srv1421380987:85 , srv1428912897:85 , srv150797013:85 , srv1622888762:85 , srv2092220594:85 , srv2136603560:85 , srv401440726:85 , srv537739534:85 , srv780286014:85 , srv829758847:85 , srv986199922:85 , srv1017907871:86 , srv1069973151:86 , srv1178473805:86 , srv1312556128:86 , srv1335817973:86 , srv1345139920:86 , srv1377198638:86 , srv1387471703:86 , srv1471582509:86 , srv1547309540:86 , srv1599898912:86 , srv1603618195:86 , srv1658150069:86 , srv1825328728:86 , srv32632263:86 , srv54040397:86 , srv554642986:86 , srv662846227:86 , srv689794248:86 , srv81351893:86 , srv843188665:86 , srv918467401:86 , srv1137667307:87 , srv1197174159:87 , srv1373726040:87 , srv1521815709:87 , srv1529423655:87 , srv1536374155:87 , srv1536578974:87 , srv1713203076:87 , srv17228116:87 , srv1724222510:87 , srv411565887:87 , srv476830977:87 , srv8159865:87 , srv98220513:87 , srv1251057778:88 , srv1308866756:88 , srv1334014991:88 , srv1350775994:88 , srv1363284916:88 , srv1473059040:88 , srv1574774873:88 , srv1647654943:88 , srv1855356128:88 , srv1937598952:88 , srv225837847:88 , srv654634220:88 , srv101305809:89 , srv1554694578:89 , srv1569431132:89 , srv163490349:89 , srv1966803559:89 , srv2067238319:89 , srv415093929:89 , srv614341047:89 , srv1567112313:90 , srv414248210:90 , srv481673614:90 , srv618687472:90 , srv1282148401:91 , srv1300943303:92 , srv1554235203:96 , srv582471953:100 , srv1932571288:443 }
2023-11-14 20:55:22,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:55:22,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1574774873=40, srv17228116=52, srv614341047=85, srv1312556128=13, srv1963775912=60, srv1471582509=27, srv1335817973=15, srv1622888762=45, srv1724222510=53, srv1473059040=28, srv1932571288=57, srv163490349=46, srv1599898912=42, srv1713203076=51, srv1642951082=47, srv1069973151=4, srv537739534=81, srv1197174159=7, srv1855356128=56, srv829758847=95, srv1536578974=34, srv1060446261=3, srv1499428320=29, srv918467401=97, srv1825328728=55, srv324297249=71, srv476830977=79, srv1294114673=10, srv662846227=88, srv758077035=90, srv401440726=75, srv2092220594=64, srv1554694578=37, srv986199922=99, srv1373726040=21, srv225837847=69, srv235236073=70, srv1137667307=5, srv135754154=18, srv81351893=92, srv1529423655=32, srv689794248=89, srv1959710049=59, srv1251057778=8, srv411565887=76, srv160861401=44, srv414248210=77, srv98220513=98, srv2067238319=63, srv1387471703=23, srv1567112313=38, srv150797013=30, srv1937598952=58, srv1369673550=20, srv1377198638=22, srv54040397=82, srv101305809=0, srv1350775994=17, srv1547309540=35, srv328668052=73, srv1178473805=6, srv1810437367=54, srv32632263=72, srv361047516=74, srv1421380987=25, srv1536374155=33, srv1966803559=61, srv1345139920=16, srv780286014=91, srv843188665=96, srv1647654943=48, srv481673614=80, srv1428912897=26, srv1569431132=39, srv142091984=24, srv654634220=87, srv1021753669=2, srv415093929=78, srv1334014991=14, srv1603618195=43, srv1308866756=12, srv2136603560=68, srv1017907871=1, srv826340631=94, srv1693649092=50, srv1598543632=41, srv1658150069=49, srv582471953=84, srv2107042168=65, srv8159865=93, srv2122642767=67, srv554642986=83, srv1363284916=19, srv2037332816=62, srv1554235203=36, srv1282148401=9, srv211968071=66, srv1300943303=11, srv618687472=86, srv1521815709=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:55:22,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:55:22,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:55:22,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:55:22,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-14 20:55:22,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-14 20:55:22,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-14 20:55:22,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-14 20:55:22,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-14 20:55:22,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-14 20:55:22,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-14 20:55:22,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-14 20:55:22,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03972972663448842, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05460808226544231, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03972972663448842, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.173, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:22,463 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-14 20:55:22,464 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1775890548437766, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03972972663448842, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05460808226544231, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03972972663448842, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.173, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-14 20:55:22,692 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 339 ms to try 5000 different iterations.  Found a solution that moves 2598 regions; Going from a computed imbalance of 0.1775890548437766 to a new imbalance of 0.014348363454081695. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980261747371608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030649534081188562, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2886666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980261747371608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:22,700 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv582471953:74 , srv1554235203:77 , srv1569431132:80 , srv101305809:81 , srv1282148401:81 , srv1300943303:81 , srv1308866756:82 , srv1350775994:82 , srv1937598952:82 , srv2067238319:82 , srv414248210:82 , srv415093929:82 , srv481673614:82 , srv614341047:82 , srv1334014991:83 , srv1554694578:83 , srv1574774873:83 , srv163490349:83 , srv1966803559:83 , srv618687472:83 , srv1345139920:84 , srv1536374155:84 , srv1567112313:84 , srv1647654943:84 , srv1658150069:84 , srv17228116:84 , srv225837847:84 , srv81351893:84 , srv1197174159:85 , srv1251057778:85 , srv1363284916:85 , srv1521815709:85 , srv1599898912:85 , srv1713203076:85 , srv476830977:85 , srv654634220:85 , srv689794248:85 , srv8159865:85 , srv98220513:85 , srv1069973151:86 , srv1137667307:86 , srv1178473805:86 , srv1335817973:86 , srv1377198638:86 , srv1387471703:86 , srv142091984:86 , srv150797013:86 , srv1529423655:86 , srv1536578974:86 , srv1547309540:86 , srv1724222510:86 , srv1810437367:86 , srv1855356128:86 , srv2092220594:86 , srv401440726:86 , srv411565887:86 , srv54040397:86 , srv780286014:86 , srv918467401:86 , srv1017907871:87 , srv1312556128:87 , srv1373726040:87 , srv1428912897:87 , srv1471582509:87 , srv1473059040:87 , srv1693649092:87 , srv1825328728:87 , srv2136603560:87 , srv32632263:87 , srv537739534:87 , srv662846227:87 , srv1021753669:88 , srv1294114673:88 , srv135754154:88 , srv1421380987:88 , srv1603618195:88 , srv1963775912:88 , srv2107042168:88 , srv328668052:88 , srv554642986:88 , srv826340631:88 , srv829758847:88 , srv843188665:88 , srv986199922:88 , srv1369673550:89 , srv1499428320:89 , srv1642951082:89 , srv1959710049:89 , srv235236073:89 , srv1598543632:90 , srv160861401:90 , srv2037332816:90 , srv2122642767:90 , srv361047516:90 , srv758077035:90 , srv1060446261:91 , srv211968071:91 , srv324297249:91 , srv1622888762:92 , srv1932571288:507 }
2023-11-14 20:55:22,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:55:22,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1574774873=40, srv17228116=52, srv614341047=85, srv1312556128=13, srv1963775912=60, srv1471582509=27, srv1335817973=15, srv1622888762=45, srv1724222510=53, srv1473059040=28, srv1932571288=57, srv163490349=46, srv1599898912=42, srv1713203076=51, srv1642951082=47, srv1069973151=4, srv537739534=81, srv1197174159=7, srv1855356128=56, srv829758847=95, srv1536578974=34, srv1060446261=3, srv1499428320=29, srv918467401=97, srv1825328728=55, srv324297249=71, srv476830977=79, srv1294114673=10, srv662846227=88, srv758077035=90, srv401440726=75, srv2092220594=64, srv1554694578=37, srv986199922=99, srv1373726040=21, srv225837847=69, srv235236073=70, srv1137667307=5, srv135754154=18, srv81351893=92, srv1529423655=32, srv689794248=89, srv1959710049=59, srv1251057778=8, srv411565887=76, srv160861401=44, srv414248210=77, srv98220513=98, srv2067238319=63, srv1387471703=23, srv1567112313=38, srv150797013=30, srv1937598952=58, srv1369673550=20, srv1377198638=22, srv54040397=82, srv101305809=0, srv1350775994=17, srv1547309540=35, srv328668052=73, srv1178473805=6, srv1810437367=54, srv32632263=72, srv361047516=74, srv1421380987=25, srv1536374155=33, srv1966803559=61, srv1345139920=16, srv780286014=91, srv843188665=96, srv1647654943=48, srv481673614=80, srv1428912897=26, srv1569431132=39, srv142091984=24, srv654634220=87, srv1021753669=2, srv415093929=78, srv1334014991=14, srv1603618195=43, srv1308866756=12, srv2136603560=68, srv1017907871=1, srv826340631=94, srv1693649092=50, srv1598543632=41, srv1658150069=49, srv582471953=84, srv2107042168=65, srv8159865=93, srv2122642767=67, srv554642986=83, srv1363284916=19, srv2037332816=62, srv1554235203=36, srv1282148401=9, srv211968071=66, srv1300943303=11, srv618687472=86, srv1521815709=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:55:22,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:55:22,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:55:22,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:55:22,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-14 20:55:22,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-14 20:55:22,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-14 20:55:22,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-14 20:55:22,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-14 20:55:22,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-14 20:55:22,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-14 20:55:22,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980261747371608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030649534081188562, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980261747371608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:22,837 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-14 20:55:22,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014330171869265156, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980261747371608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030649534081188562, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980261747371608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-14 20:55:23,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 346 ms to try 5000 different iterations.  Found a solution that moves 1050 regions; Going from a computed imbalance of 0.014330171869265156 to a new imbalance of 5.303022793170092E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003045975185965964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062495791104072804); MoveCostFunction : (multiplier=7.0, imbalance=0.11666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003045975185965964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:23,087 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1622888762:81 , srv1060446261:83 , srv1373726040:83 , srv1473059040:83 , srv1567112313:83 , srv1598543632:83 , srv843188665:83 , srv1137667307:84 , srv1197174159:84 , srv1251057778:84 , srv1536578974:84 , srv1603618195:84 , srv160861401:84 , srv1642951082:84 , srv1724222510:84 , srv1825328728:84 , srv1855356128:84 , srv2122642767:84 , srv411565887:84 , srv554642986:84 , srv582471953:84 , srv758077035:84 , srv1017907871:85 , srv1021753669:85 , srv1294114673:85 , srv1300943303:85 , srv1312556128:85 , srv1335817973:85 , srv135754154:85 , srv1369673550:85 , srv1377198638:85 , srv1421380987:85 , srv1428912897:85 , srv1471582509:85 , srv1499428320:85 , srv1521815709:85 , srv1529423655:85 , srv1536374155:85 , srv1547309540:85 , srv1554235203:85 , srv1647654943:85 , srv1713203076:85 , srv1959710049:85 , srv1963775912:85 , srv2107042168:85 , srv211968071:85 , srv235236073:85 , srv324297249:85 , srv361047516:85 , srv414248210:85 , srv537739534:85 , srv654634220:85 , srv662846227:85 , srv780286014:85 , srv8159865:85 , srv918467401:85 , srv986199922:85 , srv1178473805:86 , srv1282148401:86 , srv1334014991:86 , srv1350775994:86 , srv1363284916:86 , srv1554694578:86 , srv1966803559:86 , srv2037332816:86 , srv2136603560:86 , srv225837847:86 , srv476830977:86 , srv481673614:86 , srv54040397:86 , srv618687472:86 , srv829758847:86 , srv98220513:86 , srv1069973151:87 , srv1387471703:87 , srv142091984:87 , srv150797013:87 , srv1574774873:87 , srv163490349:87 , srv2067238319:87 , srv2092220594:87 , srv32632263:87 , srv328668052:87 , srv401440726:87 , srv415093929:87 , srv689794248:87 , srv826340631:87 , srv101305809:88 , srv1308866756:88 , srv1569431132:88 , srv1599898912:88 , srv1658150069:88 , srv1693649092:88 , srv17228116:88 , srv1810437367:88 , srv1937598952:88 , srv614341047:88 , srv81351893:88 , srv1345139920:90 , srv1932571288:534 }
2023-11-14 20:55:23,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:55:23,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1574774873=40, srv17228116=52, srv614341047=85, srv1312556128=13, srv1963775912=60, srv1471582509=27, srv1335817973=15, srv1622888762=45, srv1724222510=53, srv1473059040=28, srv1932571288=57, srv163490349=46, srv1599898912=42, srv1713203076=51, srv1642951082=47, srv1069973151=4, srv537739534=81, srv1197174159=7, srv1855356128=56, srv829758847=95, srv1536578974=34, srv1060446261=3, srv1499428320=29, srv918467401=97, srv1825328728=55, srv324297249=71, srv476830977=79, srv1294114673=10, srv662846227=88, srv758077035=90, srv401440726=75, srv2092220594=64, srv1554694578=37, srv986199922=99, srv1373726040=21, srv225837847=69, srv235236073=70, srv1137667307=5, srv135754154=18, srv81351893=92, srv1529423655=32, srv689794248=89, srv1959710049=59, srv1251057778=8, srv411565887=76, srv160861401=44, srv414248210=77, srv98220513=98, srv2067238319=63, srv1387471703=23, srv1567112313=38, srv150797013=30, srv1937598952=58, srv1369673550=20, srv1377198638=22, srv54040397=82, srv101305809=0, srv1350775994=17, srv1547309540=35, srv328668052=73, srv1178473805=6, srv1810437367=54, srv32632263=72, srv361047516=74, srv1421380987=25, srv1536374155=33, srv1966803559=61, srv1345139920=16, srv780286014=91, srv843188665=96, srv1647654943=48, srv481673614=80, srv1428912897=26, srv1569431132=39, srv142091984=24, srv654634220=87, srv1021753669=2, srv415093929=78, srv1334014991=14, srv1603618195=43, srv1308866756=12, srv2136603560=68, srv1017907871=1, srv826340631=94, srv1693649092=50, srv1598543632=41, srv1658150069=49, srv582471953=84, srv2107042168=65, srv8159865=93, srv2122642767=67, srv554642986=83, srv1363284916=19, srv2037332816=62, srv1554235203=36, srv1282148401=9, srv211968071=66, srv1300943303=11, srv618687472=86, srv1521815709=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:55:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:55:23,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-14 20:55:23,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-14 20:55:23,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-14 20:55:23,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-14 20:55:23,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-14 20:55:23,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-14 20:55:23,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-14 20:55:23,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-14 20:55:23,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003045975185965964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062495791104072804); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003045975185965964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:23,261 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-14 20:55:23,262 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.229500221740663E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003045975185965964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062495791104072804); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003045975185965964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-14 20:55:23,593 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 462 ms to try 5000 different iterations.  Found a solution that moves 226 regions; Going from a computed imbalance of 5.229500221740663E-4 to a new imbalance of 1.43649858562858E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.025111111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:23,594 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1345139920:82 , srv32632263:82 , srv826340631:82 , srv1017907871:83 , srv1069973151:83 , srv1363284916:83 , srv1387471703:83 , srv1599898912:83 , srv163490349:83 , srv328668052:83 , srv614341047:83 , srv618687472:83 , srv829758847:83 , srv101305809:84 , srv1137667307:84 , srv1178473805:84 , srv1282148401:84 , srv1294114673:84 , srv1300943303:84 , srv1308866756:84 , srv1312556128:84 , srv1373726040:84 , srv142091984:84 , srv1421380987:84 , srv1471582509:84 , srv1473059040:84 , srv150797013:84 , srv1529423655:84 , srv1554235203:84 , srv1554694578:84 , srv1574774873:84 , srv1598543632:84 , srv1603618195:84 , srv160861401:84 , srv1622888762:84 , srv1658150069:84 , srv1693649092:84 , srv17228116:84 , srv1810437367:84 , srv1855356128:84 , srv1937598952:84 , srv1959710049:84 , srv1966803559:84 , srv2037332816:84 , srv2067238319:84 , srv2092220594:84 , srv211968071:84 , srv2136603560:84 , srv225837847:84 , srv235236073:84 , srv324297249:84 , srv361047516:84 , srv401440726:84 , srv415093929:84 , srv476830977:84 , srv481673614:84 , srv54040397:84 , srv554642986:84 , srv582471953:84 , srv654634220:84 , srv689794248:84 , srv81351893:84 , srv98220513:84 , srv986199922:84 , srv1021753669:85 , srv1060446261:85 , srv1251057778:85 , srv1334014991:85 , srv1335817973:85 , srv135754154:85 , srv1369673550:85 , srv1377198638:85 , srv1428912897:85 , srv1499428320:85 , srv1521815709:85 , srv1536578974:85 , srv1547309540:85 , srv1567112313:85 , srv1569431132:85 , srv1647654943:85 , srv1713203076:85 , srv1724222510:85 , srv1825328728:85 , srv1963775912:85 , srv2107042168:85 , srv2122642767:85 , srv411565887:85 , srv414248210:85 , srv537739534:85 , srv662846227:85 , srv758077035:85 , srv8159865:85 , srv918467401:85 , srv1350775994:86 , srv1536374155:86 , srv1642951082:86 , srv780286014:86 , srv843188665:86 , srv1197174159:87 , srv1932571288:658 }
2023-11-14 20:55:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:55:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1574774873=40, srv17228116=52, srv614341047=85, srv1312556128=13, srv1963775912=60, srv1471582509=27, srv1335817973=15, srv1622888762=45, srv1724222510=53, srv1473059040=28, srv1932571288=57, srv163490349=46, srv1599898912=42, srv1713203076=51, srv1642951082=47, srv1069973151=4, srv537739534=81, srv1197174159=7, srv1855356128=56, srv829758847=95, srv1536578974=34, srv1060446261=3, srv1499428320=29, srv918467401=97, srv1825328728=55, srv324297249=71, srv476830977=79, srv1294114673=10, srv662846227=88, srv758077035=90, srv401440726=75, srv2092220594=64, srv1554694578=37, srv986199922=99, srv1373726040=21, srv225837847=69, srv235236073=70, srv1137667307=5, srv135754154=18, srv81351893=92, srv1529423655=32, srv689794248=89, srv1959710049=59, srv1251057778=8, srv411565887=76, srv160861401=44, srv414248210=77, srv98220513=98, srv2067238319=63, srv1387471703=23, srv1567112313=38, srv150797013=30, srv1937598952=58, srv1369673550=20, srv1377198638=22, srv54040397=82, srv101305809=0, srv1350775994=17, srv1547309540=35, srv328668052=73, srv1178473805=6, srv1810437367=54, srv32632263=72, srv361047516=74, srv1421380987=25, srv1536374155=33, srv1966803559=61, srv1345139920=16, srv780286014=91, srv843188665=96, srv1647654943=48, srv481673614=80, srv1428912897=26, srv1569431132=39, srv142091984=24, srv654634220=87, srv1021753669=2, srv415093929=78, srv1334014991=14, srv1603618195=43, srv1308866756=12, srv2136603560=68, srv1017907871=1, srv826340631=94, srv1693649092=50, srv1598543632=41, srv1658150069=49, srv582471953=84, srv2107042168=65, srv8159865=93, srv2122642767=67, srv554642986=83, srv1363284916=19, srv2037332816=62, srv1554235203=36, srv1282148401=9, srv211968071=66, srv1300943303=11, srv618687472=86, srv1521815709=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:55:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:55:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:55:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:55:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-14 20:55:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-14 20:55:23,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-14 20:55:23,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-14 20:55:23,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-14 20:55:23,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-14 20:55:23,713 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.2782500033138094E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:23,714 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1345139920:82 , srv32632263:82 , srv826340631:82 , srv1017907871:83 , srv1069973151:83 , srv1363284916:83 , srv1387471703:83 , srv1599898912:83 , srv163490349:83 , srv328668052:83 , srv614341047:83 , srv618687472:83 , srv829758847:83 , srv101305809:84 , srv1137667307:84 , srv1178473805:84 , srv1282148401:84 , srv1294114673:84 , srv1300943303:84 , srv1308866756:84 , srv1312556128:84 , srv1373726040:84 , srv142091984:84 , srv1421380987:84 , srv1471582509:84 , srv1473059040:84 , srv150797013:84 , srv1529423655:84 , srv1554235203:84 , srv1554694578:84 , srv1574774873:84 , srv1598543632:84 , srv1603618195:84 , srv160861401:84 , srv1622888762:84 , srv1658150069:84 , srv1693649092:84 , srv17228116:84 , srv1810437367:84 , srv1855356128:84 , srv1937598952:84 , srv1959710049:84 , srv1966803559:84 , srv2037332816:84 , srv2067238319:84 , srv2092220594:84 , srv211968071:84 , srv2136603560:84 , srv225837847:84 , srv235236073:84 , srv324297249:84 , srv361047516:84 , srv401440726:84 , srv415093929:84 , srv476830977:84 , srv481673614:84 , srv54040397:84 , srv554642986:84 , srv582471953:84 , srv654634220:84 , srv689794248:84 , srv81351893:84 , srv98220513:84 , srv986199922:84 , srv1021753669:85 , srv1060446261:85 , srv1251057778:85 , srv1334014991:85 , srv1335817973:85 , srv135754154:85 , srv1369673550:85 , srv1377198638:85 , srv1428912897:85 , srv1499428320:85 , srv1521815709:85 , srv1536578974:85 , srv1547309540:85 , srv1567112313:85 , srv1569431132:85 , srv1647654943:85 , srv1713203076:85 , srv1724222510:85 , srv1825328728:85 , srv1963775912:85 , srv2107042168:85 , srv2122642767:85 , srv411565887:85 , srv414248210:85 , srv537739534:85 , srv662846227:85 , srv758077035:85 , srv8159865:85 , srv918467401:85 , srv1350775994:86 , srv1536374155:86 , srv1642951082:86 , srv780286014:86 , srv843188665:86 , srv1197174159:87 , srv1932571288:658 }
2023-11-14 20:55:23,737 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 98) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=1710 (was 2186)
2023-11-14 20:55:23,747 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=171, AvailableMemoryMB=1710
2023-11-14 20:55:23,747 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-14 20:55:23,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-14 20:55:23,760 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1137708298:84 , srv113999753:84 , srv1235195053:84 , srv1280886912:84 , srv134450361:84 , srv1471788945:84 , srv1473762498:84 , srv1491748770:84 , srv1505115687:84 , srv1552983272:84 , srv1567481028:84 , srv1625157102:84 , srv1752799198:84 , srv1864255128:84 , srv1940429908:84 , srv2120285218:84 , srv21809817:84 , srv284322420:84 , srv304358590:84 , srv330657832:84 , srv359100421:84 , srv376014195:84 , srv431020199:84 , srv581188611:84 , srv743302826:84 , srv831140876:84 , srv841403166:84 , srv885891163:84 , srv932760538:84 , srv2048650975:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-14 20:55:23,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:55:23,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752799198=12, srv1864255128=13, srv1471788945=5, srv841403166=27, srv1505115687=8, srv2120285218=16, srv113999753=1, srv431020199=23, srv1280886912=3, srv134450361=4, srv2048650975=15, srv376014195=22, srv885891163=28, srv581188611=24, srv743302826=25, srv1137708298=0, srv21809817=17, srv330657832=20, srv1940429908=14, srv1552983272=9, srv932760538=29, srv1235195053=2, srv1473762498=6, srv284322420=18, srv1625157102=11, srv359100421=21, srv1491748770=7, srv1567481028=10, srv831140876=26, srv304358590=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:55:23,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:55:23,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:55:23,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-14 20:55:23,806 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0577013709220686, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:55:23,806 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912374858399934, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0577013709220686, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-14 20:57:23,781 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6734512 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.9912374858399934 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:57:23,786 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1137708298:90 , srv113999753:90 , srv1235195053:90 , srv1280886912:90 , srv134450361:90 , srv1471788945:90 , srv1473762498:90 , srv1491748770:90 , srv1505115687:90 , srv1552983272:90 , srv1567481028:90 , srv1625157102:90 , srv1752799198:90 , srv1864255128:90 , srv1940429908:90 , srv2048650975:90 , srv2120285218:90 , srv21809817:90 , srv284322420:90 , srv304358590:90 , srv330657832:90 , srv359100421:90 , srv376014195:90 , srv431020199:90 , srv581188611:90 , srv743302826:90 , srv831140876:90 , srv841403166:90 , srv885891163:90 , srv932760538:90 }
2023-11-14 20:57:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-14 20:57:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1752799198=12, srv1864255128=13, srv1471788945=5, srv841403166=27, srv1505115687=8, srv2120285218=16, srv113999753=1, srv431020199=23, srv1280886912=3, srv134450361=4, srv2048650975=15, srv376014195=22, srv885891163=28, srv581188611=24, srv743302826=25, srv1137708298=0, srv21809817=17, srv330657832=20, srv1940429908=14, srv1552983272=9, srv932760538=29, srv1235195053=2, srv1473762498=6, srv284322420=18, srv1625157102=11, srv359100421=21, srv1491748770=7, srv1567481028=10, srv831140876=26, srv304358590=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-14 20:57:23,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-14 20:57:23,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-14 20:57:23,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-14 20:57:23,804 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1137708298:90 , srv113999753:90 , srv1235195053:90 , srv1280886912:90 , srv134450361:90 , srv1471788945:90 , srv1473762498:90 , srv1491748770:90 , srv1505115687:90 , srv1552983272:90 , srv1567481028:90 , srv1625157102:90 , srv1752799198:90 , srv1864255128:90 , srv1940429908:90 , srv2048650975:90 , srv2120285218:90 , srv21809817:90 , srv284322420:90 , srv304358590:90 , srv330657832:90 , srv359100421:90 , srv376014195:90 , srv431020199:90 , srv581188611:90 , srv743302826:90 , srv831140876:90 , srv841403166:90 , srv885891163:90 , srv932760538:90 }
2023-11-14 20:57:23,818 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 122) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 171), AvailableMemoryMB=1677 (was 1710)