2023-05-18 23:53:22,316 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-18 23:53:22,650 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-18 23:53:22,763 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-18 23:53:22,826 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-18 23:53:22,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-18 23:53:22,851 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=169, AvailableMemoryMB=5205
2023-05-18 23:53:22,853 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-18 23:53:22,853 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-18 23:53:23,011 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008103661:84 , srv1042408022:84 , srv1051054994:84 , srv1061719825:84 , srv1095847208:84 , srv1102197510:84 , srv1111578782:84 , srv1115193188:84 , srv1116404934:84 , srv113929456:84 , srv1139511768:84 , srv1149520774:84 , srv1170981093:84 , srv1170995923:84 , srv1177262710:84 , srv1182401930:84 , srv1198168804:84 , srv1218585899:84 , srv1221554585:84 , srv1222274930:84 , srv1247578254:84 , srv1251488276:84 , srv129327979:84 , srv1359499003:84 , srv1420887077:84 , srv1433137852:84 , srv1453111272:84 , srv1457143329:84 , srv1518947654:84 , srv1536634654:84 , srv1538546643:84 , srv154503759:84 , srv1578637733:84 , srv1592199350:84 , srv159351605:84 , srv1601053600:84 , srv1604049322:84 , srv1638749287:84 , srv1645798399:84 , srv1712860123:84 , srv1732985340:84 , srv1736098246:84 , srv1747768745:84 , srv1776297347:84 , srv1778557523:84 , srv17791097:84 , srv1793046529:84 , srv1836224609:84 , srv1846727042:84 , srv1854497487:84 , srv1882857319:84 , srv1933375455:84 , srv1972760050:84 , srv2034579710:84 , srv2049739231:84 , srv2052129114:84 , srv2053083284:84 , srv2053288950:84 , srv2097440453:84 , srv2102019573:84 , srv2114125038:84 , srv263896765:84 , srv30279245:84 , srv33864457:84 , srv342915871:84 , srv355896172:84 , srv36327929:84 , srv364515814:84 , srv386557334:84 , srv41192547:84 , srv420022579:84 , srv432474728:84 , srv434664785:84 , srv482744899:84 , srv482928903:84 , srv483184111:84 , srv483319290:84 , srv487914798:84 , srv506423245:84 , srv537868665:84 , srv568366817:84 , srv580013804:84 , srv593280178:84 , srv617278095:84 , srv634853249:84 , srv642960105:84 , srv775787539:84 , srv78888547:84 , srv791188631:84 , srv836992337:84 , srv838182236:84 , srv886266976:84 , srv89092956:84 , srv922506437:84 , srv93431984:84 , srv942641320:84 , srv961733101:84 , srv983785476:84 , srv986829129:84 , srv1615266480:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-18 23:53:23,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:23,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv986829129=99, srv434664785=73, srv1645798399=39, srv1095847208=4, srv342915871=65, srv580013804=82, srv1170981093=12, srv420022579=71, srv1111578782=6, srv2053083284=57, srv1972760050=53, srv2114125038=61, srv2049739231=55, srv386557334=69, srv983785476=98, srv78888547=88, srv33864457=64, srv537868665=80, srv355896172=66, srv93431984=95, srv1933375455=52, srv1061719825=3, srv568366817=81, srv1051054994=2, srv942641320=96, srv1457143329=27, srv41192547=70, srv634853249=85, srv1793046529=47, srv506423245=79, srv1536634654=29, srv482928903=75, srv89092956=93, srv961733101=97, srv1177262710=14, srv17791097=46, srv364515814=68, srv432474728=72, srv1198168804=16, srv1538546643=30, srv1712860123=40, srv838182236=91, srv886266976=92, srv617278095=84, srv1453111272=26, srv1008103661=0, srv1882857319=51, srv1116404934=8, srv642960105=86, srv1221554585=18, srv1042408022=1, srv483319290=77, srv1592199350=33, srv1604049322=36, srv1218585899=17, srv1776297347=44, srv159351605=34, srv593280178=83, srv1433137852=25, srv483184111=76, srv1149520774=11, srv791188631=89, srv1854497487=50, srv1578637733=32, srv1139511768=10, srv1115193188=7, srv1420887077=24, srv836992337=90, srv1359499003=23, srv1736098246=42, srv2052129114=56, srv2034579710=54, srv1251488276=21, srv1846727042=49, srv2053288950=58, srv154503759=31, srv1247578254=20, srv922506437=94, srv30279245=63, srv2102019573=60, srv1836224609=48, srv1222274930=19, srv1601053600=35, srv1518947654=28, srv1638749287=38, srv263896765=62, srv1732985340=41, srv2097440453=59, srv1170995923=13, srv775787539=87, srv1182401930=15, srv1102197510=5, srv1778557523=45, srv36327929=67, srv1615266480=37, srv129327979=22, srv482744899=74, srv1747768745=43, srv487914798=78, srv113929456=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:23,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:23,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:23,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:23,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-18 23:53:23,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-18 23:53:23,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-18 23:53:23,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-18 23:53:23,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-18 23:53:23,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-18 23:53:23,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-18 23:53:23,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-18 23:53:23,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-18 23:53:23,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-18 23:53:23,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-18 23:53:23,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-18 23:53:23,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-18 23:53:23,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-18 23:53:23,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-18 23:53:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-18 23:53:23,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-18 23:53:23,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:23,322 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-18 23:53:23,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-18 23:53:23,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 642 ms to try 5000 different iterations.  Found a solution that moves 4673 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18072827545070105. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040182275802763616, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05924515825496159, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5192222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040182275802763616, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24366666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:23,799 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1111578782:82 , srv1538546643:82 , srv1736098246:82 , srv634853249:82 , srv1095847208:83 , srv113929456:83 , srv1139511768:83 , srv1247578254:83 , srv2053288950:83 , srv342915871:83 , srv36327929:83 , srv432474728:83 , srv482928903:83 , srv483319290:83 , srv506423245:83 , srv986829129:83 , srv1218585899:84 , srv1518947654:84 , srv1712860123:84 , srv1836224609:84 , srv2034579710:84 , srv2114125038:84 , srv41192547:84 , srv537868665:84 , srv1061719825:85 , srv1170981093:85 , srv1221554585:85 , srv1222274930:85 , srv1420887077:85 , srv154503759:85 , srv1601053600:85 , srv1854497487:85 , srv1882857319:85 , srv1972760050:85 , srv2102019573:85 , srv483184111:85 , srv568366817:85 , srv642960105:85 , srv775787539:85 , srv942641320:85 , srv983785476:85 , srv1149520774:86 , srv1170995923:86 , srv1177262710:86 , srv1536634654:86 , srv1747768745:86 , srv1778557523:86 , srv1933375455:86 , srv2052129114:86 , srv2097440453:86 , srv263896765:86 , srv482744899:86 , srv593280178:86 , srv1051054994:87 , srv1102197510:87 , srv1116404934:87 , srv1453111272:87 , srv1457143329:87 , srv1638749287:87 , srv2053083284:87 , srv30279245:87 , srv33864457:87 , srv836992337:87 , srv838182236:87 , srv89092956:87 , srv961733101:87 , srv1008103661:88 , srv1359499003:88 , srv1592199350:88 , srv159351605:88 , srv1604049322:88 , srv1732985340:88 , srv17791097:88 , srv1846727042:88 , srv364515814:88 , srv386557334:88 , srv580013804:88 , srv617278095:88 , srv78888547:88 , srv922506437:88 , srv93431984:88 , srv1042408022:89 , srv1115193188:89 , srv1182401930:89 , srv129327979:89 , srv1433137852:89 , srv1645798399:89 , srv355896172:89 , srv487914798:89 , srv791188631:89 , srv1251488276:90 , srv1578637733:90 , srv886266976:90 , srv1198168804:91 , srv420022579:91 , srv434664785:91 , srv1793046529:93 , srv1776297347:94 , srv2049739231:98 , srv1615266480:447 }
2023-05-18 23:53:23,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:23,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv986829129=99, srv434664785=73, srv1645798399=39, srv1095847208=4, srv342915871=65, srv580013804=82, srv1170981093=12, srv420022579=71, srv1111578782=6, srv2053083284=57, srv1972760050=53, srv2114125038=61, srv2049739231=55, srv386557334=69, srv983785476=98, srv78888547=88, srv33864457=64, srv537868665=80, srv355896172=66, srv93431984=95, srv1933375455=52, srv1061719825=3, srv568366817=81, srv1051054994=2, srv942641320=96, srv1457143329=27, srv41192547=70, srv634853249=85, srv1793046529=47, srv506423245=79, srv1536634654=29, srv482928903=75, srv89092956=93, srv961733101=97, srv1177262710=14, srv17791097=46, srv364515814=68, srv432474728=72, srv1198168804=16, srv1538546643=30, srv1712860123=40, srv838182236=91, srv886266976=92, srv617278095=84, srv1453111272=26, srv1008103661=0, srv1882857319=51, srv1116404934=8, srv642960105=86, srv1221554585=18, srv1042408022=1, srv483319290=77, srv1592199350=33, srv1604049322=36, srv1218585899=17, srv1776297347=44, srv159351605=34, srv593280178=83, srv1433137852=25, srv483184111=76, srv1149520774=11, srv791188631=89, srv1854497487=50, srv1578637733=32, srv1139511768=10, srv1115193188=7, srv1420887077=24, srv836992337=90, srv1359499003=23, srv1736098246=42, srv2052129114=56, srv2034579710=54, srv1251488276=21, srv1846727042=49, srv2053288950=58, srv154503759=31, srv1247578254=20, srv922506437=94, srv30279245=63, srv2102019573=60, srv1836224609=48, srv1222274930=19, srv1601053600=35, srv1518947654=28, srv1638749287=38, srv263896765=62, srv1732985340=41, srv2097440453=59, srv1170995923=13, srv775787539=87, srv1182401930=15, srv1102197510=5, srv1778557523=45, srv36327929=67, srv1615266480=37, srv129327979=22, srv482744899=74, srv1747768745=43, srv487914798=78, srv113929456=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:23,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:23,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:23,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:23,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:23,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:23,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:23,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-18 23:53:23,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-18 23:53:23,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-18 23:53:23,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-18 23:53:23,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-18 23:53:23,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-18 23:53:23,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-18 23:53:23,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-18 23:53:23,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-18 23:53:24,023 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040182275802763616, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05924515825496159, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040182275802763616, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24366666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:24,023 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-18 23:53:24,023 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1806955544053401, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040182275802763616, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05924515825496159, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040182275802763616, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24366666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-18 23:53:24,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 618 ms to try 5000 different iterations.  Found a solution that moves 2637 regions; Going from a computed imbalance of 0.1806955544053401 to a new imbalance of 0.014554743066099576. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0254271403968612, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04041868421497703, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.293, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0254271403968612, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04558333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:24,500 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1776297347:77 , srv1793046529:77 , srv2049739231:77 , srv1251488276:80 , srv1182401930:81 , srv1198168804:81 , srv1433137852:81 , srv1578637733:81 , srv1645798399:81 , srv617278095:81 , srv791188631:81 , srv129327979:82 , srv1453111272:82 , srv33864457:82 , srv386557334:82 , srv434664785:82 , srv886266976:82 , srv1116404934:83 , srv1592199350:83 , srv1638749287:83 , srv2052129114:83 , srv487914798:83 , srv78888547:83 , srv1008103661:84 , srv1061719825:84 , srv1115193188:84 , srv1359499003:84 , srv154503759:84 , srv1604049322:84 , srv2053083284:84 , srv364515814:84 , srv922506437:84 , srv961733101:84 , srv1042408022:85 , srv1149520774:85 , srv1222274930:85 , srv1247578254:85 , srv1457143329:85 , srv1732985340:85 , srv17791097:85 , srv1846727042:85 , srv1972760050:85 , srv2097440453:85 , srv420022579:85 , srv580013804:85 , srv89092956:85 , srv93431984:85 , srv1051054994:86 , srv1102197510:86 , srv1170981093:86 , srv1170995923:86 , srv1177262710:86 , srv1712860123:86 , srv1747768745:86 , srv1778557523:86 , srv1882857319:86 , srv1933375455:86 , srv263896765:86 , srv30279245:86 , srv355896172:86 , srv482744899:86 , srv593280178:86 , srv775787539:86 , srv838182236:86 , srv1111578782:87 , srv1218585899:87 , srv1221554585:87 , srv1420887077:87 , srv1536634654:87 , srv1854497487:87 , srv2053288950:87 , srv482928903:87 , srv506423245:87 , srv537868665:87 , srv836992337:87 , srv942641320:87 , srv983785476:87 , srv113929456:88 , srv1518947654:88 , srv1836224609:88 , srv2102019573:88 , srv483184111:88 , srv483319290:88 , srv642960105:88 , srv986829129:88 , srv1139511768:89 , srv1538546643:89 , srv159351605:89 , srv1601053600:89 , srv1736098246:89 , srv2034579710:89 , srv2114125038:89 , srv342915871:89 , srv41192547:89 , srv432474728:89 , srv568366817:89 , srv1095847208:90 , srv36327929:90 , srv634853249:93 , srv1615266480:553 }
2023-05-18 23:53:24,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:24,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv986829129=99, srv434664785=73, srv1645798399=39, srv1095847208=4, srv342915871=65, srv580013804=82, srv1170981093=12, srv420022579=71, srv1111578782=6, srv2053083284=57, srv1972760050=53, srv2114125038=61, srv2049739231=55, srv386557334=69, srv983785476=98, srv78888547=88, srv33864457=64, srv537868665=80, srv355896172=66, srv93431984=95, srv1933375455=52, srv1061719825=3, srv568366817=81, srv1051054994=2, srv942641320=96, srv1457143329=27, srv41192547=70, srv634853249=85, srv1793046529=47, srv506423245=79, srv1536634654=29, srv482928903=75, srv89092956=93, srv961733101=97, srv1177262710=14, srv17791097=46, srv364515814=68, srv432474728=72, srv1198168804=16, srv1538546643=30, srv1712860123=40, srv838182236=91, srv886266976=92, srv617278095=84, srv1453111272=26, srv1008103661=0, srv1882857319=51, srv1116404934=8, srv642960105=86, srv1221554585=18, srv1042408022=1, srv483319290=77, srv1592199350=33, srv1604049322=36, srv1218585899=17, srv1776297347=44, srv159351605=34, srv593280178=83, srv1433137852=25, srv483184111=76, srv1149520774=11, srv791188631=89, srv1854497487=50, srv1578637733=32, srv1139511768=10, srv1115193188=7, srv1420887077=24, srv836992337=90, srv1359499003=23, srv1736098246=42, srv2052129114=56, srv2034579710=54, srv1251488276=21, srv1846727042=49, srv2053288950=58, srv154503759=31, srv1247578254=20, srv922506437=94, srv30279245=63, srv2102019573=60, srv1836224609=48, srv1222274930=19, srv1601053600=35, srv1518947654=28, srv1638749287=38, srv263896765=62, srv1732985340=41, srv2097440453=59, srv1170995923=13, srv775787539=87, srv1182401930=15, srv1102197510=5, srv1778557523=45, srv36327929=67, srv1615266480=37, srv129327979=22, srv482744899=74, srv1747768745=43, srv487914798=78, srv113929456=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:24,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:24,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:24,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:24,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:24,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:24,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-18 23:53:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-18 23:53:24,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-18 23:53:24,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-18 23:53:24,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-18 23:53:24,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-18 23:53:24,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-18 23:53:24,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-18 23:53:24,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-18 23:53:24,811 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0254271403968612, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04041868421497703, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0254271403968612, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04558333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:24,811 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-18 23:53:24,811 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014536278397446298, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0254271403968612, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04041868421497703, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0254271403968612, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04558333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-18 23:53:25,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 579 ms to try 5000 different iterations.  Found a solution that moves 977 regions; Going from a computed imbalance of 0.014536278397446298 to a new imbalance of 8.18179475330627E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006763236226828305); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006338735955449387); MoveCostFunction : (multiplier=7.0, imbalance=0.10855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006763236226828305); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:25,160 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv159351605:81 , srv420022579:82 , srv634853249:82 , srv1601053600:83 , srv2049739231:83 , srv568366817:83 , srv1042408022:84 , srv1051054994:84 , srv1115193188:84 , srv1536634654:84 , srv1732985340:84 , srv1846727042:84 , srv2114125038:84 , srv30279245:84 , srv355896172:84 , srv36327929:84 , srv434664785:84 , srv483184111:84 , srv580013804:84 , srv836992337:84 , srv93431984:84 , srv1008103661:85 , srv1095847208:85 , srv1102197510:85 , srv1170981093:85 , srv1170995923:85 , srv1198168804:85 , srv1221554585:85 , srv1457143329:85 , srv1518947654:85 , srv1778557523:85 , srv17791097:85 , srv1854497487:85 , srv2034579710:85 , srv2102019573:85 , srv263896765:85 , srv342915871:85 , srv364515814:85 , srv41192547:85 , srv432474728:85 , srv482744899:85 , srv593280178:85 , srv642960105:85 , srv838182236:85 , srv886266976:85 , srv89092956:85 , srv922506437:85 , srv942641320:85 , srv113929456:86 , srv1139511768:86 , srv1177262710:86 , srv129327979:86 , srv1359499003:86 , srv1420887077:86 , srv1538546643:86 , srv1578637733:86 , srv1592199350:86 , srv1604049322:86 , srv1645798399:86 , srv1736098246:86 , srv1747768745:86 , srv1836224609:86 , srv1882857319:86 , srv1933375455:86 , srv483319290:86 , srv487914798:86 , srv775787539:86 , srv78888547:86 , srv986829129:86 , srv1149520774:87 , srv1218585899:87 , srv1251488276:87 , srv1433137852:87 , srv1638749287:87 , srv1712860123:87 , srv1776297347:87 , srv2053083284:87 , srv2053288950:87 , srv2097440453:87 , srv386557334:87 , srv482928903:87 , srv537868665:87 , srv791188631:87 , srv961733101:87 , srv983785476:87 , srv1061719825:88 , srv1111578782:88 , srv1116404934:88 , srv1182401930:88 , srv1222274930:88 , srv1453111272:88 , srv154503759:88 , srv1793046529:88 , srv1972760050:88 , srv33864457:88 , srv506423245:88 , srv1247578254:89 , srv2052129114:89 , srv617278095:89 , srv1615266480:518 }
2023-05-18 23:53:25,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:25,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv986829129=99, srv434664785=73, srv1645798399=39, srv1095847208=4, srv342915871=65, srv580013804=82, srv1170981093=12, srv420022579=71, srv1111578782=6, srv2053083284=57, srv1972760050=53, srv2114125038=61, srv2049739231=55, srv386557334=69, srv983785476=98, srv78888547=88, srv33864457=64, srv537868665=80, srv355896172=66, srv93431984=95, srv1933375455=52, srv1061719825=3, srv568366817=81, srv1051054994=2, srv942641320=96, srv1457143329=27, srv41192547=70, srv634853249=85, srv1793046529=47, srv506423245=79, srv1536634654=29, srv482928903=75, srv89092956=93, srv961733101=97, srv1177262710=14, srv17791097=46, srv364515814=68, srv432474728=72, srv1198168804=16, srv1538546643=30, srv1712860123=40, srv838182236=91, srv886266976=92, srv617278095=84, srv1453111272=26, srv1008103661=0, srv1882857319=51, srv1116404934=8, srv642960105=86, srv1221554585=18, srv1042408022=1, srv483319290=77, srv1592199350=33, srv1604049322=36, srv1218585899=17, srv1776297347=44, srv159351605=34, srv593280178=83, srv1433137852=25, srv483184111=76, srv1149520774=11, srv791188631=89, srv1854497487=50, srv1578637733=32, srv1139511768=10, srv1115193188=7, srv1420887077=24, srv836992337=90, srv1359499003=23, srv1736098246=42, srv2052129114=56, srv2034579710=54, srv1251488276=21, srv1846727042=49, srv2053288950=58, srv154503759=31, srv1247578254=20, srv922506437=94, srv30279245=63, srv2102019573=60, srv1836224609=48, srv1222274930=19, srv1601053600=35, srv1518947654=28, srv1638749287=38, srv263896765=62, srv1732985340=41, srv2097440453=59, srv1170995923=13, srv775787539=87, srv1182401930=15, srv1102197510=5, srv1778557523=45, srv36327929=67, srv1615266480=37, srv129327979=22, srv482744899=74, srv1747768745=43, srv487914798=78, srv113929456=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:25,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:25,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:25,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:25,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-18 23:53:25,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-18 23:53:25,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-18 23:53:25,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-18 23:53:25,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-18 23:53:25,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-18 23:53:25,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-18 23:53:25,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-18 23:53:25,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006763236226828305); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006338735955449387); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006763236226828305); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:25,349 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-18 23:53:25,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.113383751128603E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006763236226828305); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006338735955449387); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006763236226828305); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-18 23:53:25,743 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 255 regions; Going from a computed imbalance of 8.113383751128603E-4 to a new imbalance of 3.377108171006936E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.028333333333333332, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:25,744 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1972760050:83 , srv355896172:83 , srv983785476:83 , srv1042408022:84 , srv1095847208:84 , srv1102197510:84 , srv1116404934:84 , srv1139511768:84 , srv1149520774:84 , srv1170995923:84 , srv1177262710:84 , srv1182401930:84 , srv1218585899:84 , srv1222274930:84 , srv1359499003:84 , srv1420887077:84 , srv1453111272:84 , srv1604049322:84 , srv1776297347:84 , srv17791097:84 , srv1836224609:84 , srv1933375455:84 , srv2034579710:84 , srv2052129114:84 , srv2053083284:84 , srv2097440453:84 , srv2102019573:84 , srv263896765:84 , srv41192547:84 , srv420022579:84 , srv432474728:84 , srv434664785:84 , srv483319290:84 , srv487914798:84 , srv506423245:84 , srv537868665:84 , srv642960105:84 , srv89092956:84 , srv942641320:84 , srv961733101:84 , srv1008103661:85 , srv1051054994:85 , srv1061719825:85 , srv1111578782:85 , srv1115193188:85 , srv113929456:85 , srv1198168804:85 , srv1221554585:85 , srv1247578254:85 , srv1251488276:85 , srv129327979:85 , srv1433137852:85 , srv1518947654:85 , srv1536634654:85 , srv1538546643:85 , srv154503759:85 , srv1578637733:85 , srv1592199350:85 , srv159351605:85 , srv1601053600:85 , srv1638749287:85 , srv1712860123:85 , srv1732985340:85 , srv1736098246:85 , srv1747768745:85 , srv1778557523:85 , srv1793046529:85 , srv1846727042:85 , srv1854497487:85 , srv2049739231:85 , srv2053288950:85 , srv2114125038:85 , srv30279245:85 , srv342915871:85 , srv36327929:85 , srv364515814:85 , srv386557334:85 , srv482744899:85 , srv482928903:85 , srv483184111:85 , srv568366817:85 , srv580013804:85 , srv593280178:85 , srv617278095:85 , srv634853249:85 , srv775787539:85 , srv78888547:85 , srv791188631:85 , srv836992337:85 , srv838182236:85 , srv886266976:85 , srv922506437:85 , srv93431984:85 , srv986829129:85 , srv1170981093:86 , srv1457143329:86 , srv1645798399:86 , srv1882857319:86 , srv33864457:86 , srv1615266480:623 }
2023-05-18 23:53:25,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:25,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv986829129=99, srv434664785=73, srv1645798399=39, srv1095847208=4, srv342915871=65, srv580013804=82, srv1170981093=12, srv420022579=71, srv1111578782=6, srv2053083284=57, srv1972760050=53, srv2114125038=61, srv2049739231=55, srv386557334=69, srv983785476=98, srv78888547=88, srv33864457=64, srv537868665=80, srv355896172=66, srv93431984=95, srv1933375455=52, srv1061719825=3, srv568366817=81, srv1051054994=2, srv942641320=96, srv1457143329=27, srv41192547=70, srv634853249=85, srv1793046529=47, srv506423245=79, srv1536634654=29, srv482928903=75, srv89092956=93, srv961733101=97, srv1177262710=14, srv17791097=46, srv364515814=68, srv432474728=72, srv1198168804=16, srv1538546643=30, srv1712860123=40, srv838182236=91, srv886266976=92, srv617278095=84, srv1453111272=26, srv1008103661=0, srv1882857319=51, srv1116404934=8, srv642960105=86, srv1221554585=18, srv1042408022=1, srv483319290=77, srv1592199350=33, srv1604049322=36, srv1218585899=17, srv1776297347=44, srv159351605=34, srv593280178=83, srv1433137852=25, srv483184111=76, srv1149520774=11, srv791188631=89, srv1854497487=50, srv1578637733=32, srv1139511768=10, srv1115193188=7, srv1420887077=24, srv836992337=90, srv1359499003=23, srv1736098246=42, srv2052129114=56, srv2034579710=54, srv1251488276=21, srv1846727042=49, srv2053288950=58, srv154503759=31, srv1247578254=20, srv922506437=94, srv30279245=63, srv2102019573=60, srv1836224609=48, srv1222274930=19, srv1601053600=35, srv1518947654=28, srv1638749287=38, srv263896765=62, srv1732985340=41, srv2097440453=59, srv1170995923=13, srv775787539=87, srv1182401930=15, srv1102197510=5, srv1778557523=45, srv36327929=67, srv1615266480=37, srv129327979=22, srv482744899=74, srv1747768745=43, srv487914798=78, srv113929456=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:25,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:25,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:25,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-18 23:53:25,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-18 23:53:25,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-18 23:53:25,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-18 23:53:25,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-18 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-18 23:53:25,873 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:25,873 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-18 23:53:25,873 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.198553354678323E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-18 23:53:26,116 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 343 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 3.198553354678323E-5 to a new imbalance of 3.917947539274539E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=8.206099398622181E-4); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:26,116 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1457143329:83 , srv159351605:83 , srv1747768745:83 , srv1793046529:83 , srv1882857319:83 , srv2049739231:83 , srv33864457:83 , srv617278095:83 , srv836992337:83 , srv838182236:83 , srv1008103661:84 , srv1042408022:84 , srv1051054994:84 , srv1061719825:84 , srv1095847208:84 , srv1102197510:84 , srv1111578782:84 , srv1115193188:84 , srv1116404934:84 , srv113929456:84 , srv1139511768:84 , srv1149520774:84 , srv1170981093:84 , srv1177262710:84 , srv1182401930:84 , srv1198168804:84 , srv1218585899:84 , srv1221554585:84 , srv1222274930:84 , srv1247578254:84 , srv1251488276:84 , srv129327979:84 , srv1359499003:84 , srv1420887077:84 , srv1433137852:84 , srv1518947654:84 , srv1536634654:84 , srv1538546643:84 , srv154503759:84 , srv1578637733:84 , srv1592199350:84 , srv1601053600:84 , srv1604049322:84 , srv1638749287:84 , srv1645798399:84 , srv1712860123:84 , srv1732985340:84 , srv1736098246:84 , srv1776297347:84 , srv1778557523:84 , srv17791097:84 , srv1836224609:84 , srv1846727042:84 , srv1854497487:84 , srv1933375455:84 , srv2034579710:84 , srv2052129114:84 , srv2053083284:84 , srv2053288950:84 , srv2097440453:84 , srv2102019573:84 , srv2114125038:84 , srv30279245:84 , srv342915871:84 , srv355896172:84 , srv36327929:84 , srv364515814:84 , srv386557334:84 , srv41192547:84 , srv420022579:84 , srv482744899:84 , srv482928903:84 , srv483184111:84 , srv487914798:84 , srv506423245:84 , srv537868665:84 , srv568366817:84 , srv580013804:84 , srv593280178:84 , srv634853249:84 , srv642960105:84 , srv775787539:84 , srv78888547:84 , srv791188631:84 , srv886266976:84 , srv922506437:84 , srv93431984:84 , srv961733101:84 , srv983785476:84 , srv986829129:84 , srv1170995923:85 , srv1453111272:85 , srv1972760050:85 , srv263896765:85 , srv432474728:85 , srv434664785:85 , srv483319290:85 , srv89092956:85 , srv942641320:85 , srv1615266480:685 }
2023-05-18 23:53:26,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:26,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv986829129=99, srv434664785=73, srv1645798399=39, srv1095847208=4, srv342915871=65, srv580013804=82, srv1170981093=12, srv420022579=71, srv1111578782=6, srv2053083284=57, srv1972760050=53, srv2114125038=61, srv2049739231=55, srv386557334=69, srv983785476=98, srv78888547=88, srv33864457=64, srv537868665=80, srv355896172=66, srv93431984=95, srv1933375455=52, srv1061719825=3, srv568366817=81, srv1051054994=2, srv942641320=96, srv1457143329=27, srv41192547=70, srv634853249=85, srv1793046529=47, srv506423245=79, srv1536634654=29, srv482928903=75, srv89092956=93, srv961733101=97, srv1177262710=14, srv17791097=46, srv364515814=68, srv432474728=72, srv1198168804=16, srv1538546643=30, srv1712860123=40, srv838182236=91, srv886266976=92, srv617278095=84, srv1453111272=26, srv1008103661=0, srv1882857319=51, srv1116404934=8, srv642960105=86, srv1221554585=18, srv1042408022=1, srv483319290=77, srv1592199350=33, srv1604049322=36, srv1218585899=17, srv1776297347=44, srv159351605=34, srv593280178=83, srv1433137852=25, srv483184111=76, srv1149520774=11, srv791188631=89, srv1854497487=50, srv1578637733=32, srv1139511768=10, srv1115193188=7, srv1420887077=24, srv836992337=90, srv1359499003=23, srv1736098246=42, srv2052129114=56, srv2034579710=54, srv1251488276=21, srv1846727042=49, srv2053288950=58, srv154503759=31, srv1247578254=20, srv922506437=94, srv30279245=63, srv2102019573=60, srv1836224609=48, srv1222274930=19, srv1601053600=35, srv1518947654=28, srv1638749287=38, srv263896765=62, srv1732985340=41, srv2097440453=59, srv1170995923=13, srv775787539=87, srv1182401930=15, srv1102197510=5, srv1778557523=45, srv36327929=67, srv1615266480=37, srv129327979=22, srv482744899=74, srv1747768745=43, srv487914798=78, srv113929456=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:26,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:26,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-18 23:53:26,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-18 23:53:26,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-18 23:53:26,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-18 23:53:26,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-18 23:53:26,244 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=3.6938787501562794E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=8.206099398622181E-4); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:26,244 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1457143329:83 , srv159351605:83 , srv1747768745:83 , srv1793046529:83 , srv1882857319:83 , srv2049739231:83 , srv33864457:83 , srv617278095:83 , srv836992337:83 , srv838182236:83 , srv1008103661:84 , srv1042408022:84 , srv1051054994:84 , srv1061719825:84 , srv1095847208:84 , srv1102197510:84 , srv1111578782:84 , srv1115193188:84 , srv1116404934:84 , srv113929456:84 , srv1139511768:84 , srv1149520774:84 , srv1170981093:84 , srv1177262710:84 , srv1182401930:84 , srv1198168804:84 , srv1218585899:84 , srv1221554585:84 , srv1222274930:84 , srv1247578254:84 , srv1251488276:84 , srv129327979:84 , srv1359499003:84 , srv1420887077:84 , srv1433137852:84 , srv1518947654:84 , srv1536634654:84 , srv1538546643:84 , srv154503759:84 , srv1578637733:84 , srv1592199350:84 , srv1601053600:84 , srv1604049322:84 , srv1638749287:84 , srv1645798399:84 , srv1712860123:84 , srv1732985340:84 , srv1736098246:84 , srv1776297347:84 , srv1778557523:84 , srv17791097:84 , srv1836224609:84 , srv1846727042:84 , srv1854497487:84 , srv1933375455:84 , srv2034579710:84 , srv2052129114:84 , srv2053083284:84 , srv2053288950:84 , srv2097440453:84 , srv2102019573:84 , srv2114125038:84 , srv30279245:84 , srv342915871:84 , srv355896172:84 , srv36327929:84 , srv364515814:84 , srv386557334:84 , srv41192547:84 , srv420022579:84 , srv482744899:84 , srv482928903:84 , srv483184111:84 , srv487914798:84 , srv506423245:84 , srv537868665:84 , srv568366817:84 , srv580013804:84 , srv593280178:84 , srv634853249:84 , srv642960105:84 , srv775787539:84 , srv78888547:84 , srv791188631:84 , srv886266976:84 , srv922506437:84 , srv93431984:84 , srv961733101:84 , srv983785476:84 , srv986829129:84 , srv1170995923:85 , srv1453111272:85 , srv1972760050:85 , srv263896765:85 , srv432474728:85 , srv434664785:85 , srv483319290:85 , srv89092956:85 , srv942641320:85 , srv1615266480:685 }
2023-05-18 23:53:26,267 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 279), ProcessCount=169 (was 169), AvailableMemoryMB=4575 (was 5205)
2023-05-18 23:53:26,275 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=169, AvailableMemoryMB=4575
2023-05-18 23:53:26,275 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-18 23:53:26,276 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-18 23:53:26,287 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1045349124:84 , srv1061726664:84 , srv1135406734:84 , srv1170821907:84 , srv1229697159:84 , srv1328542494:84 , srv1353517662:84 , srv1438077243:84 , srv1472393434:84 , srv1651862463:84 , srv1808619392:84 , srv1819957041:84 , srv2099158736:84 , srv2130814706:84 , srv319407423:84 , srv363032862:84 , srv390980818:84 , srv417344154:84 , srv421369612:84 , srv469328239:84 , srv483908791:84 , srv541676022:84 , srv666758218:84 , srv683501709:84 , srv774534440:84 , srv79086357:84 , srv845810284:84 , srv866200208:84 , srv92362875:84 , srv242623611:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-18 23:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:53:26,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv666758218=23, srv2099158736=12, srv1229697159=4, srv483908791=21, srv363032862=16, srv1328542494=5, srv469328239=20, srv242623611=14, srv1651862463=9, srv1135406734=2, srv390980818=17, srv683501709=24, srv1061726664=1, srv2130814706=13, srv1170821907=3, srv1353517662=6, srv1808619392=10, srv319407423=15, srv541676022=22, srv1472393434=8, srv845810284=27, srv421369612=19, srv417344154=18, srv1819957041=11, srv79086357=26, srv774534440=25, srv1045349124=0, srv1438077243=7, srv92362875=29, srv866200208=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:53:26,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-18 23:53:26,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0842461879779046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:53:26,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912458500251707, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0842461879779046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-18 23:55:26,305 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5496754 different iterations.  Found a solution that moves 1865 regions; Going from a computed imbalance of 0.9912458500251707 to a new imbalance of 4.353003038599517E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6907407407407408, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:55:26,312 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1045349124:90 , srv1061726664:90 , srv1135406734:90 , srv1170821907:90 , srv1229697159:90 , srv1328542494:90 , srv1353517662:90 , srv1438077243:90 , srv1472393434:90 , srv1651862463:90 , srv1808619392:90 , srv1819957041:90 , srv2099158736:90 , srv2130814706:90 , srv242623611:90 , srv319407423:90 , srv363032862:90 , srv390980818:90 , srv417344154:90 , srv421369612:90 , srv469328239:90 , srv483908791:90 , srv541676022:90 , srv666758218:90 , srv683501709:90 , srv774534440:90 , srv79086357:90 , srv845810284:90 , srv866200208:90 , srv92362875:90 }
2023-05-18 23:55:26,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-18 23:55:26,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv666758218=23, srv2099158736=12, srv1229697159=4, srv483908791=21, srv363032862=16, srv1328542494=5, srv469328239=20, srv242623611=14, srv1651862463=9, srv1135406734=2, srv390980818=17, srv683501709=24, srv1061726664=1, srv2130814706=13, srv1170821907=3, srv1353517662=6, srv1808619392=10, srv319407423=15, srv541676022=22, srv1472393434=8, srv845810284=27, srv421369612=19, srv417344154=18, srv1819957041=11, srv79086357=26, srv774534440=25, srv1045349124=0, srv1438077243=7, srv92362875=29, srv866200208=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-18 23:55:26,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-18 23:55:26,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-18 23:55:26,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-18 23:55:26,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-18 23:55:26,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-18 23:55:26,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-18 23:55:26,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-18 23:55:26,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-18 23:55:26,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-18 23:55:26,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-18 23:55:26,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-18 23:55:26,333 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-18 23:55:26,334 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1045349124:90 , srv1061726664:90 , srv1135406734:90 , srv1170821907:90 , srv1229697159:90 , srv1328542494:90 , srv1353517662:90 , srv1438077243:90 , srv1472393434:90 , srv1651862463:90 , srv1808619392:90 , srv1819957041:90 , srv2099158736:90 , srv2130814706:90 , srv242623611:90 , srv319407423:90 , srv363032862:90 , srv390980818:90 , srv417344154:90 , srv421369612:90 , srv469328239:90 , srv483908791:90 , srv541676022:90 , srv666758218:90 , srv683501709:90 , srv774534440:90 , srv79086357:90 , srv845810284:90 , srv866200208:90 , srv92362875:90 }
2023-05-18 23:55:26,346 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 279), ProcessCount=169 (was 169), AvailableMemoryMB=4000 (was 4575)