2023-02-13 16:56:15,235 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-13 16:56:15,563 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-13 16:56:15,664 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-13 16:56:15,724 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-13 16:56:15,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-13 16:56:15,746 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=107, ProcessCount=168, AvailableMemoryMB=1906
2023-02-13 16:56:15,748 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-13 16:56:15,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-13 16:56:15,865 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008401360:84 , srv1009687154:84 , srv1022390921:84 , srv1023548571:84 , srv1046808999:84 , srv1061640434:84 , srv1074788725:84 , srv111409638:84 , srv1114627509:84 , srv1121504844:84 , srv1124535261:84 , srv1137780908:84 , srv1161958873:84 , srv1166544870:84 , srv1167979024:84 , srv1184427498:84 , srv1186184647:84 , srv1187140970:84 , srv1207865649:84 , srv1217748160:84 , srv1223680779:84 , srv1254553216:84 , srv1288045904:84 , srv1312587938:84 , srv1313353165:84 , srv1314144255:84 , srv1367983636:84 , srv1417546548:84 , srv1428456255:84 , srv1428783341:84 , srv1440050213:84 , srv1464054848:84 , srv1513029456:84 , srv153354891:84 , srv1552237590:84 , srv1557581749:84 , srv1559842207:84 , srv1588930910:84 , srv1612796137:84 , srv1653601301:84 , srv1654857519:84 , srv1704116254:84 , srv1708631988:84 , srv1731752796:84 , srv173182247:84 , srv1740042766:84 , srv1742124928:84 , srv1744606140:84 , srv1834423315:84 , srv1835042230:84 , srv1849097495:84 , srv1893853827:84 , srv1909883207:84 , srv1927683683:84 , srv195735683:84 , srv197957918:84 , srv1995051588:84 , srv2007516239:84 , srv2026885897:84 , srv2064112393:84 , srv2116131850:84 , srv2126902631:84 , srv2146475782:84 , srv248496981:84 , srv254992633:84 , srv326176340:84 , srv336967599:84 , srv343075192:84 , srv385727501:84 , srv393099115:84 , srv443463894:84 , srv469483038:84 , srv490778061:84 , srv503313540:84 , srv556586204:84 , srv571212551:84 , srv57903068:84 , srv58766596:84 , srv591502567:84 , srv597311433:84 , srv609767249:84 , srv616136946:84 , srv667701991:84 , srv671873406:84 , srv676652596:84 , srv702960694:84 , srv734887493:84 , srv764569113:84 , srv776202116:84 , srv778117349:84 , srv779609840:84 , srv780778624:84 , srv810149061:84 , srv830169241:84 , srv861842499:84 , srv869338274:84 , srv911628825:84 , srv950460481:84 , srv999947196:84 , srv985069095:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-13 16:56:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:56:15,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1552237590=34, srv1023548571=3, srv999947196=99, srv503313540=73, srv1137780908=11, srv1708631988=42, srv671873406=83, srv1428456255=28, srv326176340=65, srv1061640434=5, srv1207865649=18, srv1074788725=6, srv780778624=91, srv1893853827=51, srv1186184647=16, srv197957918=55, srv153354891=33, srv490778061=72, srv1835042230=49, srv609767249=80, srv393099115=69, srv1927683683=53, srv616136946=81, srv58766596=77, srv1114627509=8, srv1223680779=20, srv1588930910=37, srv1995051588=56, srv1559842207=36, srv764569113=87, srv195735683=54, srv1740042766=45, srv1009687154=1, srv1288045904=22, srv248496981=63, srv343075192=67, srv1704116254=41, srv702960694=85, srv1008401360=0, srv1312587938=23, srv1654857519=40, srv2146475782=62, srv1166544870=13, srv2026885897=58, srv1124535261=10, srv571212551=75, srv869338274=95, srv1022390921=2, srv985069095=98, srv2007516239=57, srv254992633=64, srv1367983636=26, srv1557581749=35, srv1744606140=47, srv1187140970=17, srv776202116=88, srv830169241=93, srv778117349=89, srv556586204=74, srv676652596=84, srv1834423315=48, srv57903068=76, srv591502567=78, srv1464054848=31, srv911628825=96, srv1184427498=15, srv1909883207=52, srv779609840=90, srv950460481=97, srv1513029456=32, srv2126902631=61, srv1161958873=12, srv1121504844=9, srv469483038=71, srv336967599=66, srv1254553216=21, srv173182247=44, srv667701991=82, srv111409638=7, srv1742124928=46, srv597311433=79, srv1046808999=4, srv385727501=68, srv443463894=70, srv1731752796=43, srv1440050213=30, srv2064112393=59, srv810149061=92, srv1428783341=29, srv734887493=86, srv1167979024=14, srv1653601301=39, srv1849097495=50, srv1417546548=27, srv1313353165=24, srv861842499=94, srv1612796137=38, srv1217748160=19, srv1314144255=25, srv2116131850=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:56:15,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:56:15,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:56:15,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:56:15,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:56:15,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:56:15,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:56:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:56:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:56:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:56:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:56:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:56:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:56:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:56:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:56:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:56:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:56:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:56:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:56:15,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:56:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:56:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:56:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:56:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:56:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:56:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-13 16:56:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-13 16:56:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-13 16:56:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-13 16:56:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-13 16:56:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-13 16:56:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-13 16:56:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-13 16:56:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-13 16:56:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-13 16:56:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-13 16:56:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-13 16:56:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-13 16:56:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-13 16:56:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-13 16:56:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-13 16:56:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-13 16:56:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-13 16:56:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-13 16:56:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-13 16:56:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-13 16:56:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-13 16:56:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-13 16:56:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-13 16:56:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-13 16:56:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-13 16:56:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-13 16:56:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-13 16:56:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-13 16:56:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-13 16:56:16,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-13 16:56:16,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-13 16:56:16,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-13 16:56:16,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-13 16:56:16,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-13 16:56:16,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:16,310 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-13 16:56:16,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-13 16:56:16,682 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 645 ms to try 5000 different iterations.  Found a solution that moves 4681 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18239862116073838. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040214538767965984, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05193883997205846, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5201111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040214538767965984, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24091666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:16,703 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv111409638:81 , srv1313353165:81 , srv1834423315:81 , srv1909883207:81 , srv830169241:81 , srv1022390921:82 , srv2126902631:82 , srv869338274:82 , srv1464054848:83 , srv1731752796:83 , srv195735683:83 , srv702960694:83 , srv1046808999:84 , srv1186184647:84 , srv1314144255:84 , srv1367983636:84 , srv1428783341:84 , srv1588930910:84 , srv1742124928:84 , srv1849097495:84 , srv2116131850:84 , srv385727501:84 , srv780778624:84 , srv950460481:84 , srv1009687154:85 , srv1184427498:85 , srv1187140970:85 , srv1312587938:85 , srv1559842207:85 , srv1835042230:85 , srv1995051588:85 , srv2007516239:85 , srv393099115:85 , srv490778061:85 , srv556586204:85 , srv57903068:85 , srv667701991:85 , srv764569113:85 , srv778117349:85 , srv1008401360:86 , srv1023548571:86 , srv1074788725:86 , srv1124535261:86 , srv1137780908:86 , srv1166544870:86 , srv1217748160:86 , srv1428456255:86 , srv153354891:86 , srv1557581749:86 , srv1653601301:86 , srv1704116254:86 , srv173182247:86 , srv1740042766:86 , srv1744606140:86 , srv248496981:86 , srv469483038:86 , srv571212551:86 , srv676652596:86 , srv1121504844:87 , srv1207865649:87 , srv1254553216:87 , srv1654857519:87 , srv1927683683:87 , srv2026885897:87 , srv2064112393:87 , srv326176340:87 , srv336967599:87 , srv343075192:87 , srv443463894:87 , srv58766596:87 , srv609767249:87 , srv671873406:87 , srv911628825:87 , srv999947196:87 , srv1114627509:88 , srv1417546548:88 , srv1440050213:88 , srv254992633:88 , srv734887493:88 , srv776202116:88 , srv779609840:88 , srv810149061:88 , srv1708631988:89 , srv1893853827:89 , srv197957918:89 , srv1223680779:90 , srv1513029456:90 , srv591502567:90 , srv616136946:90 , srv1061640434:91 , srv1161958873:91 , srv1552237590:91 , srv503313540:91 , srv597311433:91 , srv1167979024:93 , srv1612796137:94 , srv861842499:94 , srv2146475782:95 , srv1288045904:99 , srv985069095:447 }
2023-02-13 16:56:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:56:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1552237590=34, srv1023548571=3, srv999947196=99, srv503313540=73, srv1137780908=11, srv1708631988=42, srv671873406=83, srv1428456255=28, srv326176340=65, srv1061640434=5, srv1207865649=18, srv1074788725=6, srv780778624=91, srv1893853827=51, srv1186184647=16, srv197957918=55, srv153354891=33, srv490778061=72, srv1835042230=49, srv609767249=80, srv393099115=69, srv1927683683=53, srv616136946=81, srv58766596=77, srv1114627509=8, srv1223680779=20, srv1588930910=37, srv1995051588=56, srv1559842207=36, srv764569113=87, srv195735683=54, srv1740042766=45, srv1009687154=1, srv1288045904=22, srv248496981=63, srv343075192=67, srv1704116254=41, srv702960694=85, srv1008401360=0, srv1312587938=23, srv1654857519=40, srv2146475782=62, srv1166544870=13, srv2026885897=58, srv1124535261=10, srv571212551=75, srv869338274=95, srv1022390921=2, srv985069095=98, srv2007516239=57, srv254992633=64, srv1367983636=26, srv1557581749=35, srv1744606140=47, srv1187140970=17, srv776202116=88, srv830169241=93, srv778117349=89, srv556586204=74, srv676652596=84, srv1834423315=48, srv57903068=76, srv591502567=78, srv1464054848=31, srv911628825=96, srv1184427498=15, srv1909883207=52, srv779609840=90, srv950460481=97, srv1513029456=32, srv2126902631=61, srv1161958873=12, srv1121504844=9, srv469483038=71, srv336967599=66, srv1254553216=21, srv173182247=44, srv667701991=82, srv111409638=7, srv1742124928=46, srv597311433=79, srv1046808999=4, srv385727501=68, srv443463894=70, srv1731752796=43, srv1440050213=30, srv2064112393=59, srv810149061=92, srv1428783341=29, srv734887493=86, srv1167979024=14, srv1653601301=39, srv1849097495=50, srv1417546548=27, srv1313353165=24, srv861842499=94, srv1612796137=38, srv1217748160=19, srv1314144255=25, srv2116131850=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:56:16,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:56:16,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-13 16:56:16,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-13 16:56:16,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-13 16:56:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-13 16:56:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-13 16:56:16,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-13 16:56:16,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-13 16:56:16,878 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040214538767965984, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05193883997205846, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040214538767965984, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24091666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:16,878 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-13 16:56:16,878 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18236584409818019, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040214538767965984, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05193883997205846, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040214538767965984, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24091666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-13 16:56:17,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 466 ms to try 5000 different iterations.  Found a solution that moves 2639 regions; Going from a computed imbalance of 0.18236584409818019 to a new imbalance of 0.013691437621017388. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020828937059528606); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02854889282802309, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2932222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020828937059528606); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:17,234 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2146475782:76 , srv1288045904:77 , srv1612796137:77 , srv861842499:78 , srv1167979024:79 , srv1061640434:81 , srv1161958873:81 , srv1513029456:81 , srv1708631988:81 , srv1223680779:82 , srv503313540:82 , srv591502567:82 , srv616136946:82 , srv734887493:82 , srv1008401360:83 , srv1121504844:83 , srv1417546548:83 , srv1552237590:83 , srv1893853827:83 , srv1927683683:83 , srv197957918:83 , srv2026885897:83 , srv58766596:83 , srv597311433:83 , srv776202116:83 , srv779609840:83 , srv1207865649:84 , srv1428456255:84 , srv1654857519:84 , srv173182247:84 , srv326176340:84 , srv443463894:84 , srv911628825:84 , srv1114627509:85 , srv1137780908:85 , srv1166544870:85 , srv1217748160:85 , srv1254553216:85 , srv1704116254:85 , srv2064112393:85 , srv254992633:85 , srv343075192:85 , srv609767249:85 , srv667701991:85 , srv1124535261:86 , srv1440050213:86 , srv1835042230:86 , srv2007516239:86 , srv336967599:86 , srv469483038:86 , srv1009687154:87 , srv1023548571:87 , srv1184427498:87 , srv1187140970:87 , srv1314144255:87 , srv1740042766:87 , srv1744606140:87 , srv2116131850:87 , srv385727501:87 , srv556586204:87 , srv671873406:87 , srv810149061:87 , srv999947196:87 , srv1428783341:88 , srv1559842207:88 , srv1588930910:88 , srv1653601301:88 , srv1742124928:88 , srv1849097495:88 , srv195735683:88 , srv1995051588:88 , srv393099115:88 , srv57903068:88 , srv676652596:88 , srv702960694:88 , srv778117349:88 , srv780778624:88 , srv830169241:88 , srv869338274:88 , srv950460481:88 , srv1046808999:89 , srv1074788725:89 , srv1312587938:89 , srv1367983636:89 , srv153354891:89 , srv1557581749:89 , srv1909883207:89 , srv248496981:89 , srv490778061:89 , srv571212551:89 , srv1022390921:90 , srv1186184647:90 , srv1464054848:90 , srv1731752796:90 , srv764569113:90 , srv111409638:91 , srv1834423315:91 , srv2126902631:91 , srv1313353165:92 , srv985069095:512 }
2023-02-13 16:56:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:56:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1552237590=34, srv1023548571=3, srv999947196=99, srv503313540=73, srv1137780908=11, srv1708631988=42, srv671873406=83, srv1428456255=28, srv326176340=65, srv1061640434=5, srv1207865649=18, srv1074788725=6, srv780778624=91, srv1893853827=51, srv1186184647=16, srv197957918=55, srv153354891=33, srv490778061=72, srv1835042230=49, srv609767249=80, srv393099115=69, srv1927683683=53, srv616136946=81, srv58766596=77, srv1114627509=8, srv1223680779=20, srv1588930910=37, srv1995051588=56, srv1559842207=36, srv764569113=87, srv195735683=54, srv1740042766=45, srv1009687154=1, srv1288045904=22, srv248496981=63, srv343075192=67, srv1704116254=41, srv702960694=85, srv1008401360=0, srv1312587938=23, srv1654857519=40, srv2146475782=62, srv1166544870=13, srv2026885897=58, srv1124535261=10, srv571212551=75, srv869338274=95, srv1022390921=2, srv985069095=98, srv2007516239=57, srv254992633=64, srv1367983636=26, srv1557581749=35, srv1744606140=47, srv1187140970=17, srv776202116=88, srv830169241=93, srv778117349=89, srv556586204=74, srv676652596=84, srv1834423315=48, srv57903068=76, srv591502567=78, srv1464054848=31, srv911628825=96, srv1184427498=15, srv1909883207=52, srv779609840=90, srv950460481=97, srv1513029456=32, srv2126902631=61, srv1161958873=12, srv1121504844=9, srv469483038=71, srv336967599=66, srv1254553216=21, srv173182247=44, srv667701991=82, srv111409638=7, srv1742124928=46, srv597311433=79, srv1046808999=4, srv385727501=68, srv443463894=70, srv1731752796=43, srv1440050213=30, srv2064112393=59, srv810149061=92, srv1428783341=29, srv734887493=86, srv1167979024=14, srv1653601301=39, srv1849097495=50, srv1417546548=27, srv1313353165=24, srv861842499=94, srv1612796137=38, srv1217748160=19, srv1314144255=25, srv2116131850=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:56:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:56:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-13 16:56:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-13 16:56:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-13 16:56:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-13 16:56:17,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-13 16:56:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-13 16:56:17,413 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020828937059528606); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02854889282802309, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020828937059528606); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:17,413 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-13 16:56:17,413 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01367295894806479, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020828937059528606); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02854889282802309, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020828937059528606); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-13 16:56:17,710 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 423 ms to try 5000 different iterations.  Found a solution that moves 900 regions; Going from a computed imbalance of 0.01367295894806479 to a new imbalance of 4.97639066176955E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005206785216983458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006914582258636295); MoveCostFunction : (multiplier=7.0, imbalance=0.1, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005206785216983458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:17,712 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1074788725:81 , srv1288045904:82 , srv1557581749:82 , srv571212551:82 , srv764569113:82 , srv1312587938:83 , srv153354891:83 , srv671873406:83 , srv676652596:83 , srv810149061:83 , srv999947196:83 , srv1313353165:84 , srv1367983636:84 , srv1440050213:84 , srv1464054848:84 , srv1552237590:84 , srv1653601301:84 , srv1731752796:84 , srv2126902631:84 , srv248496981:84 , srv254992633:84 , srv336967599:84 , srv393099115:84 , srv490778061:84 , srv503313540:84 , srv57903068:84 , srv597311433:84 , srv1022390921:85 , srv1023548571:85 , srv1046808999:85 , srv1061640434:85 , srv111409638:85 , srv1114627509:85 , srv1161958873:85 , srv1186184647:85 , srv1187140970:85 , srv1254553216:85 , srv1428783341:85 , srv1588930910:85 , srv1740042766:85 , srv1742124928:85 , srv1744606140:85 , srv1849097495:85 , srv1995051588:85 , srv343075192:85 , srv556586204:85 , srv591502567:85 , srv778117349:85 , srv950460481:85 , srv1009687154:86 , srv1124535261:86 , srv1137780908:86 , srv1167979024:86 , srv1184427498:86 , srv1207865649:86 , srv1217748160:86 , srv1223680779:86 , srv1513029456:86 , srv1559842207:86 , srv1612796137:86 , srv1834423315:86 , srv1835042230:86 , srv1893853827:86 , srv197957918:86 , srv2064112393:86 , srv2116131850:86 , srv2146475782:86 , srv443463894:86 , srv469483038:86 , srv609767249:86 , srv616136946:86 , srv702960694:86 , srv779609840:86 , srv780778624:86 , srv861842499:86 , srv911628825:86 , srv1121504844:87 , srv1166544870:87 , srv1314144255:87 , srv1417546548:87 , srv1428456255:87 , srv1654857519:87 , srv1704116254:87 , srv1909883207:87 , srv1927683683:87 , srv195735683:87 , srv2007516239:87 , srv326176340:87 , srv385727501:87 , srv667701991:87 , srv869338274:87 , srv1708631988:88 , srv173182247:88 , srv2026885897:88 , srv58766596:88 , srv734887493:88 , srv776202116:88 , srv830169241:89 , srv1008401360:90 , srv985069095:545 }
2023-02-13 16:56:17,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:56:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1552237590=34, srv1023548571=3, srv999947196=99, srv503313540=73, srv1137780908=11, srv1708631988=42, srv671873406=83, srv1428456255=28, srv326176340=65, srv1061640434=5, srv1207865649=18, srv1074788725=6, srv780778624=91, srv1893853827=51, srv1186184647=16, srv197957918=55, srv153354891=33, srv490778061=72, srv1835042230=49, srv609767249=80, srv393099115=69, srv1927683683=53, srv616136946=81, srv58766596=77, srv1114627509=8, srv1223680779=20, srv1588930910=37, srv1995051588=56, srv1559842207=36, srv764569113=87, srv195735683=54, srv1740042766=45, srv1009687154=1, srv1288045904=22, srv248496981=63, srv343075192=67, srv1704116254=41, srv702960694=85, srv1008401360=0, srv1312587938=23, srv1654857519=40, srv2146475782=62, srv1166544870=13, srv2026885897=58, srv1124535261=10, srv571212551=75, srv869338274=95, srv1022390921=2, srv985069095=98, srv2007516239=57, srv254992633=64, srv1367983636=26, srv1557581749=35, srv1744606140=47, srv1187140970=17, srv776202116=88, srv830169241=93, srv778117349=89, srv556586204=74, srv676652596=84, srv1834423315=48, srv57903068=76, srv591502567=78, srv1464054848=31, srv911628825=96, srv1184427498=15, srv1909883207=52, srv779609840=90, srv950460481=97, srv1513029456=32, srv2126902631=61, srv1161958873=12, srv1121504844=9, srv469483038=71, srv336967599=66, srv1254553216=21, srv173182247=44, srv667701991=82, srv111409638=7, srv1742124928=46, srv597311433=79, srv1046808999=4, srv385727501=68, srv443463894=70, srv1731752796=43, srv1440050213=30, srv2064112393=59, srv810149061=92, srv1428783341=29, srv734887493=86, srv1167979024=14, srv1653601301=39, srv1849097495=50, srv1417546548=27, srv1313353165=24, srv861842499=94, srv1612796137=38, srv1217748160=19, srv1314144255=25, srv2116131850=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:56:17,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:56:17,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-13 16:56:17,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-13 16:56:17,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-13 16:56:17,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-13 16:56:17,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-13 16:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-13 16:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-13 16:56:17,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-13 16:56:17,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-13 16:56:17,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-13 16:56:17,867 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005206785216983458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006914582258636295); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005206785216983458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:17,868 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-13 16:56:17,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.91337131483004E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005206785216983458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006914582258636295); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005206785216983458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-13 16:56:18,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 365 ms to try 5000 different iterations.  Found a solution that moves 213 regions; Going from a computed imbalance of 4.91337131483004E-4 to a new imbalance of 1.8836654123716602E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.023666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:18,131 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1167979024:83 , srv1186184647:83 , srv1559842207:83 , srv2026885897:83 , srv248496981:83 , srv776202116:83 , srv1008401360:84 , srv1023548571:84 , srv1046808999:84 , srv1114627509:84 , srv1124535261:84 , srv1166544870:84 , srv1184427498:84 , srv1223680779:84 , srv1288045904:84 , srv1314144255:84 , srv1417546548:84 , srv1440050213:84 , srv153354891:84 , srv1552237590:84 , srv1653601301:84 , srv1654857519:84 , srv1704116254:84 , srv1708631988:84 , srv173182247:84 , srv1740042766:84 , srv1744606140:84 , srv1834423315:84 , srv1893853827:84 , srv195735683:84 , srv197957918:84 , srv1995051588:84 , srv2007516239:84 , srv2064112393:84 , srv2126902631:84 , srv385727501:84 , srv469483038:84 , srv58766596:84 , srv591502567:84 , srv597311433:84 , srv609767249:84 , srv616136946:84 , srv667701991:84 , srv734887493:84 , srv778117349:84 , srv780778624:84 , srv810149061:84 , srv861842499:84 , srv1009687154:85 , srv1022390921:85 , srv1061640434:85 , srv1074788725:85 , srv111409638:85 , srv1137780908:85 , srv1161958873:85 , srv1187140970:85 , srv1207865649:85 , srv1217748160:85 , srv1254553216:85 , srv1312587938:85 , srv1313353165:85 , srv1367983636:85 , srv1428456255:85 , srv1428783341:85 , srv1464054848:85 , srv1513029456:85 , srv1557581749:85 , srv1588930910:85 , srv1612796137:85 , srv1731752796:85 , srv1742124928:85 , srv1835042230:85 , srv1849097495:85 , srv1909883207:85 , srv1927683683:85 , srv2116131850:85 , srv2146475782:85 , srv254992633:85 , srv326176340:85 , srv336967599:85 , srv343075192:85 , srv393099115:85 , srv443463894:85 , srv490778061:85 , srv503313540:85 , srv556586204:85 , srv571212551:85 , srv57903068:85 , srv671873406:85 , srv676652596:85 , srv702960694:85 , srv764569113:85 , srv779609840:85 , srv830169241:85 , srv869338274:85 , srv911628825:85 , srv950460481:85 , srv999947196:85 , srv1121504844:86 , srv985069095:638 }
2023-02-13 16:56:18,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:56:18,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1552237590=34, srv1023548571=3, srv999947196=99, srv503313540=73, srv1137780908=11, srv1708631988=42, srv671873406=83, srv1428456255=28, srv326176340=65, srv1061640434=5, srv1207865649=18, srv1074788725=6, srv780778624=91, srv1893853827=51, srv1186184647=16, srv197957918=55, srv153354891=33, srv490778061=72, srv1835042230=49, srv609767249=80, srv393099115=69, srv1927683683=53, srv616136946=81, srv58766596=77, srv1114627509=8, srv1223680779=20, srv1588930910=37, srv1995051588=56, srv1559842207=36, srv764569113=87, srv195735683=54, srv1740042766=45, srv1009687154=1, srv1288045904=22, srv248496981=63, srv343075192=67, srv1704116254=41, srv702960694=85, srv1008401360=0, srv1312587938=23, srv1654857519=40, srv2146475782=62, srv1166544870=13, srv2026885897=58, srv1124535261=10, srv571212551=75, srv869338274=95, srv1022390921=2, srv985069095=98, srv2007516239=57, srv254992633=64, srv1367983636=26, srv1557581749=35, srv1744606140=47, srv1187140970=17, srv776202116=88, srv830169241=93, srv778117349=89, srv556586204=74, srv676652596=84, srv1834423315=48, srv57903068=76, srv591502567=78, srv1464054848=31, srv911628825=96, srv1184427498=15, srv1909883207=52, srv779609840=90, srv950460481=97, srv1513029456=32, srv2126902631=61, srv1161958873=12, srv1121504844=9, srv469483038=71, srv336967599=66, srv1254553216=21, srv173182247=44, srv667701991=82, srv111409638=7, srv1742124928=46, srv597311433=79, srv1046808999=4, srv385727501=68, srv443463894=70, srv1731752796=43, srv1440050213=30, srv2064112393=59, srv810149061=92, srv1428783341=29, srv734887493=86, srv1167979024=14, srv1653601301=39, srv1849097495=50, srv1417546548=27, srv1313353165=24, srv861842499=94, srv1612796137=38, srv1217748160=19, srv1314144255=25, srv2116131850=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:56:18,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-13 16:56:18,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-13 16:56:18,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-13 16:56:18,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-13 16:56:18,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-13 16:56:18,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-13 16:56:18,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.734519624614819E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:18,266 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1167979024:83 , srv1186184647:83 , srv1559842207:83 , srv2026885897:83 , srv248496981:83 , srv776202116:83 , srv1008401360:84 , srv1023548571:84 , srv1046808999:84 , srv1114627509:84 , srv1124535261:84 , srv1166544870:84 , srv1184427498:84 , srv1223680779:84 , srv1288045904:84 , srv1314144255:84 , srv1417546548:84 , srv1440050213:84 , srv153354891:84 , srv1552237590:84 , srv1653601301:84 , srv1654857519:84 , srv1704116254:84 , srv1708631988:84 , srv173182247:84 , srv1740042766:84 , srv1744606140:84 , srv1834423315:84 , srv1893853827:84 , srv195735683:84 , srv197957918:84 , srv1995051588:84 , srv2007516239:84 , srv2064112393:84 , srv2126902631:84 , srv385727501:84 , srv469483038:84 , srv58766596:84 , srv591502567:84 , srv597311433:84 , srv609767249:84 , srv616136946:84 , srv667701991:84 , srv734887493:84 , srv778117349:84 , srv780778624:84 , srv810149061:84 , srv861842499:84 , srv1009687154:85 , srv1022390921:85 , srv1061640434:85 , srv1074788725:85 , srv111409638:85 , srv1137780908:85 , srv1161958873:85 , srv1187140970:85 , srv1207865649:85 , srv1217748160:85 , srv1254553216:85 , srv1312587938:85 , srv1313353165:85 , srv1367983636:85 , srv1428456255:85 , srv1428783341:85 , srv1464054848:85 , srv1513029456:85 , srv1557581749:85 , srv1588930910:85 , srv1612796137:85 , srv1731752796:85 , srv1742124928:85 , srv1835042230:85 , srv1849097495:85 , srv1909883207:85 , srv1927683683:85 , srv2116131850:85 , srv2146475782:85 , srv254992633:85 , srv326176340:85 , srv336967599:85 , srv343075192:85 , srv393099115:85 , srv443463894:85 , srv490778061:85 , srv503313540:85 , srv556586204:85 , srv571212551:85 , srv57903068:85 , srv671873406:85 , srv676652596:85 , srv702960694:85 , srv764569113:85 , srv779609840:85 , srv830169241:85 , srv869338274:85 , srv911628825:85 , srv950460481:85 , srv999947196:85 , srv1121504844:86 , srv985069095:638 }
2023-02-13 16:56:18,299 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 107) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1414 (was 1906)
2023-02-13 16:56:18,310 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=139, ProcessCount=168, AvailableMemoryMB=1413
2023-02-13 16:56:18,311 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-13 16:56:18,311 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-13 16:56:18,322 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1196728292:84 , srv131661310:84 , srv1369934530:84 , srv1399615310:84 , srv1415414550:84 , srv1453428896:84 , srv1567090348:84 , srv1571344153:84 , srv1648766431:84 , srv1809637025:84 , srv1855506676:84 , srv1869368279:84 , srv1969503573:84 , srv2010083625:84 , srv2038239407:84 , srv2058186600:84 , srv2101924860:84 , srv267980602:84 , srv299952371:84 , srv389583542:84 , srv425822686:84 , srv452297174:84 , srv490615336:84 , srv693529750:84 , srv760223461:84 , srv806638380:84 , srv885430628:84 , srv933964421:84 , srv984810130:84 , srv904992221:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-13 16:56:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:56:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv267980602=17, srv131661310=1, srv1196728292=0, srv1369934530=2, srv490615336=22, srv933964421=28, srv1399615310=3, srv1567090348=6, srv1855506676=10, srv806638380=25, srv389583542=19, srv1869368279=11, srv1969503573=12, srv2058186600=15, srv2010083625=13, srv885430628=26, srv425822686=20, srv984810130=29, srv1809637025=9, srv452297174=21, srv904992221=27, srv2101924860=16, srv693529750=23, srv1415414550=4, srv1571344153=7, srv1453428896=5, srv299952371=18, srv1648766431=8, srv2038239407=14, srv760223461=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:56:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:56:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:56:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:56:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:56:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:56:18,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:56:18,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:56:18,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:56:18,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:56:18,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-13 16:56:18,353 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1422652523606112, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:56:18,354 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912641316429079, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1422652523606112, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-13 16:58:18,338 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6117168 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912641316429079 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:58:18,344 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1196728292:90 , srv131661310:90 , srv1369934530:90 , srv1399615310:90 , srv1415414550:90 , srv1453428896:90 , srv1567090348:90 , srv1571344153:90 , srv1648766431:90 , srv1809637025:90 , srv1855506676:90 , srv1869368279:90 , srv1969503573:90 , srv2010083625:90 , srv2038239407:90 , srv2058186600:90 , srv2101924860:90 , srv267980602:90 , srv299952371:90 , srv389583542:90 , srv425822686:90 , srv452297174:90 , srv490615336:90 , srv693529750:90 , srv760223461:90 , srv806638380:90 , srv885430628:90 , srv904992221:90 , srv933964421:90 , srv984810130:90 }
2023-02-13 16:58:18,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-13 16:58:18,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv267980602=17, srv131661310=1, srv1196728292=0, srv1369934530=2, srv490615336=22, srv933964421=28, srv1399615310=3, srv1567090348=6, srv1855506676=10, srv806638380=25, srv389583542=19, srv1869368279=11, srv1969503573=12, srv2058186600=15, srv2010083625=13, srv885430628=26, srv425822686=20, srv984810130=29, srv1809637025=9, srv452297174=21, srv904992221=27, srv2101924860=16, srv693529750=23, srv1415414550=4, srv1571344153=7, srv1453428896=5, srv299952371=18, srv1648766431=8, srv2038239407=14, srv760223461=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-13 16:58:18,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-13 16:58:18,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-13 16:58:18,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-13 16:58:18,361 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1196728292:90 , srv131661310:90 , srv1369934530:90 , srv1399615310:90 , srv1415414550:90 , srv1453428896:90 , srv1567090348:90 , srv1571344153:90 , srv1648766431:90 , srv1809637025:90 , srv1855506676:90 , srv1869368279:90 , srv1969503573:90 , srv2010083625:90 , srv2038239407:90 , srv2058186600:90 , srv2101924860:90 , srv267980602:90 , srv299952371:90 , srv389583542:90 , srv425822686:90 , srv452297174:90 , srv490615336:90 , srv693529750:90 , srv760223461:90 , srv806638380:90 , srv885430628:90 , srv904992221:90 , srv933964421:90 , srv984810130:90 }
2023-02-13 16:58:18,373 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 139) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1505 (was 1413) - AvailableMemoryMB LEAK? -