2023-11-06 03:58:51,668 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-06 03:58:51,966 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-06 03:58:52,091 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-06 03:58:52,167 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-06 03:58:52,174 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-06 03:58:52,187 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=454, ProcessCount=166, AvailableMemoryMB=11281
2023-11-06 03:58:52,189 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-06 03:58:52,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-06 03:58:52,331 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012272755:84 , srv1043245058:84 , srv1045554879:84 , srv105313650:84 , srv1062388771:84 , srv1081893947:84 , srv109822682:84 , srv1109242625:84 , srv1120446726:84 , srv1134490368:84 , srv1142060743:84 , srv1166501323:84 , srv116900654:84 , srv1189056621:84 , srv1242330091:84 , srv1248166255:84 , srv1253491344:84 , srv1263729722:84 , srv1280679840:84 , srv1313892034:84 , srv1336586180:84 , srv1352667330:84 , srv1353705596:84 , srv1442270318:84 , srv1444058524:84 , srv1514476146:84 , srv1526052392:84 , srv1527074530:84 , srv1528474527:84 , srv1553469062:84 , srv1568100739:84 , srv1607303546:84 , srv1617386860:84 , srv1628400995:84 , srv1628521161:84 , srv1646913581:84 , srv1672218601:84 , srv1685976875:84 , srv1734560824:84 , srv1744520115:84 , srv1803719487:84 , srv1815544242:84 , srv184056127:84 , srv1888802404:84 , srv1904343123:84 , srv1911023999:84 , srv196706029:84 , srv1969198479:84 , srv1983427265:84 , srv1991798669:84 , srv2024233397:84 , srv2060664612:84 , srv2086911112:84 , srv2105430438:84 , srv2131834598:84 , srv247555496:84 , srv270832687:84 , srv303364450:84 , srv313733966:84 , srv32527587:84 , srv334829120:84 , srv389349741:84 , srv405301698:84 , srv422339779:84 , srv45447562:84 , srv455819833:84 , srv457763125:84 , srv461422296:84 , srv488626423:84 , srv534904747:84 , srv536893141:84 , srv553324152:84 , srv574127192:84 , srv574355134:84 , srv587808678:84 , srv591581070:84 , srv603117291:84 , srv678333295:84 , srv684874002:84 , srv685425219:84 , srv695818647:84 , srv702281033:84 , srv703046622:84 , srv704056076:84 , srv708431304:84 , srv718797501:84 , srv793821910:84 , srv807880765:84 , srv820868051:84 , srv823985140:84 , srv870897713:84 , srv883755957:84 , srv897111627:84 , srv911930069:84 , srv929404607:84 , srv931368152:84 , srv971610836:84 , srv987818054:84 , srv997925212:84 , srv59899997:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-06 03:58:52,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:52,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv574127192=72, srv807880765=88, srv911930069=94, srv1527074530=27, srv1983427265=48, srv1142060743=10, srv2131834598=54, srv1081893947=5, srv1134490368=9, srv1911023999=45, srv987818054=98, srv2086911112=52, srv1109242625=7, srv334829120=60, srv270832687=56, srv1628400995=33, srv1734560824=38, srv1526052392=26, srv685425219=80, srv1744520115=39, srv1607303546=31, srv1568100739=30, srv1120446726=8, srv1045554879=2, srv971610836=97, srv574355134=73, srv1248166255=15, srv1617386860=32, srv702281033=82, srv45447562=64, srv405301698=62, srv1888802404=43, srv820868051=89, srv1313892034=19, srv184056127=42, srv488626423=68, srv603117291=77, srv793821910=87, srv1672218601=36, srv1991798669=49, srv1528474527=28, srv1646913581=35, srv1263729722=17, srv897111627=93, srv870897713=91, srv1803719487=40, srv2105430438=53, srv422339779=63, srv883755957=92, srv116900654=12, srv1043245058=1, srv247555496=55, srv587808678=74, srv718797501=86, srv32527587=59, srv1336586180=20, srv1815544242=41, srv303364450=57, srv1444058524=24, srv313733966=58, srv1628521161=34, srv823985140=90, srv1242330091=14, srv1969198479=47, srv695818647=81, srv708431304=85, srv997925212=99, srv1353705596=22, srv196706029=46, srv105313650=3, srv684874002=79, srv703046622=83, srv678333295=78, srv1904343123=44, srv1352667330=21, srv1166501323=11, srv534904747=69, srv457763125=66, srv929404607=95, srv1253491344=16, srv704056076=84, srv109822682=6, srv2060664612=51, srv1062388771=4, srv1012272755=0, srv1189056621=13, srv1685976875=37, srv1553469062=29, srv591581070=75, srv1514476146=25, srv1280679840=18, srv2024233397=50, srv59899997=76, srv553324152=71, srv461422296=67, srv931368152=96, srv1442270318=23, srv389349741=61, srv536893141=70, srv455819833=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:52,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:52,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:52,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:52,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:52,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:52,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:52,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:52,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:52,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:52,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:52,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:52,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:52,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:52,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-06 03:58:52,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-06 03:58:52,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-06 03:58:52,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-06 03:58:52,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-06 03:58:52,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-06 03:58:52,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-06 03:58:52,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-06 03:58:52,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-06 03:58:52,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-06 03:58:52,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-06 03:58:52,635 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:52,635 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-06 03:58:52,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-06 03:58:52,979 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 490 ms to try 5000 different iterations.  Found a solution that moves 4767 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17237545590438172. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038490665920620865, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.060296685113613295, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5296666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038490665920620865, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16733333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23591666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,004 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1744520115:81 , srv2024233397:81 , srv455819833:81 , srv929404607:81 , srv574355134:82 , srv1313892034:83 , srv1442270318:83 , srv184056127:83 , srv718797501:83 , srv1081893947:84 , srv1242330091:84 , srv1353705596:84 , srv1528474527:84 , srv1568100739:84 , srv1607303546:84 , srv1815544242:84 , srv870897713:84 , srv971610836:84 , srv1142060743:85 , srv116900654:85 , srv1189056621:85 , srv1280679840:85 , srv1352667330:85 , srv1672218601:85 , srv1685976875:85 , srv1734560824:85 , srv1888802404:85 , srv196706029:85 , srv2105430438:85 , srv303364450:85 , srv534904747:85 , srv591581070:85 , srv793821910:85 , srv807880765:85 , srv823985140:85 , srv997925212:85 , srv1120446726:86 , srv1166501323:86 , srv1514476146:86 , srv1526052392:86 , srv1628521161:86 , srv1646913581:86 , srv1904343123:86 , srv1969198479:86 , srv2131834598:86 , srv461422296:86 , srv536893141:86 , srv684874002:86 , srv695818647:86 , srv702281033:86 , srv708431304:86 , srv897111627:86 , srv911930069:86 , srv931368152:86 , srv1012272755:87 , srv109822682:87 , srv1134490368:87 , srv1263729722:87 , srv1527074530:87 , srv1628400995:87 , srv1911023999:87 , srv1991798669:87 , srv2086911112:87 , srv587808678:87 , srv685425219:87 , srv820868051:87 , srv1043245058:88 , srv1109242625:88 , srv1336586180:88 , srv1444058524:88 , srv1553469062:88 , srv1803719487:88 , srv247555496:88 , srv313733966:88 , srv334829120:88 , srv405301698:88 , srv457763125:88 , srv488626423:88 , srv574127192:88 , srv105313650:89 , srv1062388771:89 , srv1248166255:89 , srv603117291:89 , srv678333295:89 , srv1253491344:90 , srv1617386860:90 , srv2060664612:90 , srv32527587:90 , srv389349741:90 , srv45447562:90 , srv703046622:90 , srv704056076:90 , srv1045554879:91 , srv422339779:91 , srv883755957:91 , srv553324152:92 , srv987818054:92 , srv1983427265:93 , srv270832687:93 , srv59899997:432 }
2023-11-06 03:58:53,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:53,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv574127192=72, srv807880765=88, srv911930069=94, srv1527074530=27, srv1983427265=48, srv1142060743=10, srv2131834598=54, srv1081893947=5, srv1134490368=9, srv1911023999=45, srv987818054=98, srv2086911112=52, srv1109242625=7, srv334829120=60, srv270832687=56, srv1628400995=33, srv1734560824=38, srv1526052392=26, srv685425219=80, srv1744520115=39, srv1607303546=31, srv1568100739=30, srv1120446726=8, srv1045554879=2, srv971610836=97, srv574355134=73, srv1248166255=15, srv1617386860=32, srv702281033=82, srv45447562=64, srv405301698=62, srv1888802404=43, srv820868051=89, srv1313892034=19, srv184056127=42, srv488626423=68, srv603117291=77, srv793821910=87, srv1672218601=36, srv1991798669=49, srv1528474527=28, srv1646913581=35, srv1263729722=17, srv897111627=93, srv870897713=91, srv1803719487=40, srv2105430438=53, srv422339779=63, srv883755957=92, srv116900654=12, srv1043245058=1, srv247555496=55, srv587808678=74, srv718797501=86, srv32527587=59, srv1336586180=20, srv1815544242=41, srv303364450=57, srv1444058524=24, srv313733966=58, srv1628521161=34, srv823985140=90, srv1242330091=14, srv1969198479=47, srv695818647=81, srv708431304=85, srv997925212=99, srv1353705596=22, srv196706029=46, srv105313650=3, srv684874002=79, srv703046622=83, srv678333295=78, srv1904343123=44, srv1352667330=21, srv1166501323=11, srv534904747=69, srv457763125=66, srv929404607=95, srv1253491344=16, srv704056076=84, srv109822682=6, srv2060664612=51, srv1062388771=4, srv1012272755=0, srv1189056621=13, srv1685976875=37, srv1553469062=29, srv591581070=75, srv1514476146=25, srv1280679840=18, srv2024233397=50, srv59899997=76, srv553324152=71, srv461422296=67, srv931368152=96, srv1442270318=23, srv389349741=61, srv536893141=70, srv455819833=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:53,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:53,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:53,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:53,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-06 03:58:53,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-06 03:58:53,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-06 03:58:53,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-06 03:58:53,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-06 03:58:53,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-06 03:58:53,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-06 03:58:53,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-06 03:58:53,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-06 03:58:53,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-06 03:58:53,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-06 03:58:53,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-06 03:58:53,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038490665920620865, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.060296685113613295, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038490665920620865, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16733333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23591666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,159 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-06 03:58:53,159 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17234207665695273, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038490665920620865, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.060296685113613295, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038490665920620865, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16733333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23591666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-06 03:58:53,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 265 ms to try 5000 different iterations.  Found a solution that moves 2598 regions; Going from a computed imbalance of 0.17234207665695273 to a new imbalance of 0.013645111250012231. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020483615429410466); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043690576125747935, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2886666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020483615429410466); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,353 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1983427265:78 , srv270832687:79 , srv1253491344:80 , srv32527587:80 , srv553324152:80 , srv45447562:81 , srv704056076:81 , srv987818054:81 , srv1062388771:82 , srv1553469062:82 , srv389349741:82 , srv678333295:82 , srv883755957:82 , srv1045554879:83 , srv1248166255:83 , srv1444058524:83 , srv1617386860:83 , srv2060664612:83 , srv247555496:83 , srv1043245058:84 , srv109822682:84 , srv1109242625:84 , srv1263729722:84 , srv1336586180:84 , srv334829120:84 , srv405301698:84 , srv422339779:84 , srv457763125:84 , srv587808678:84 , srv695818647:84 , srv703046622:84 , srv820868051:84 , srv1012272755:85 , srv105313650:85 , srv1134490368:85 , srv1514476146:85 , srv1526052392:85 , srv1628521161:85 , srv1646913581:85 , srv1672218601:85 , srv1803719487:85 , srv1904343123:85 , srv1991798669:85 , srv2086911112:85 , srv2131834598:85 , srv313733966:85 , srv461422296:85 , srv488626423:85 , srv603117291:85 , srv685425219:85 , srv807880765:85 , srv1120446726:86 , srv1628400995:86 , srv1685976875:86 , srv1734560824:86 , srv1911023999:86 , srv196706029:86 , srv591581070:86 , srv911930069:86 , srv1142060743:87 , srv1189056621:87 , srv1352667330:87 , srv1527074530:87 , srv1815544242:87 , srv184056127:87 , srv2105430438:87 , srv303364450:87 , srv534904747:87 , srv574127192:87 , srv684874002:87 , srv702281033:87 , srv718797501:87 , srv823985140:87 , srv971610836:87 , srv1166501323:88 , srv116900654:88 , srv1242330091:88 , srv1568100739:88 , srv1888802404:88 , srv1969198479:88 , srv536893141:88 , srv574355134:88 , srv708431304:88 , srv793821910:88 , srv997925212:88 , srv1280679840:89 , srv1442270318:89 , srv1607303546:89 , srv2024233397:89 , srv897111627:89 , srv931368152:89 , srv1081893947:90 , srv1313892034:90 , srv1353705596:90 , srv1528474527:90 , srv455819833:90 , srv870897713:90 , srv1744520115:91 , srv929404607:95 , srv59899997:524 }
2023-11-06 03:58:53,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:53,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv574127192=72, srv807880765=88, srv911930069=94, srv1527074530=27, srv1983427265=48, srv1142060743=10, srv2131834598=54, srv1081893947=5, srv1134490368=9, srv1911023999=45, srv987818054=98, srv2086911112=52, srv1109242625=7, srv334829120=60, srv270832687=56, srv1628400995=33, srv1734560824=38, srv1526052392=26, srv685425219=80, srv1744520115=39, srv1607303546=31, srv1568100739=30, srv1120446726=8, srv1045554879=2, srv971610836=97, srv574355134=73, srv1248166255=15, srv1617386860=32, srv702281033=82, srv45447562=64, srv405301698=62, srv1888802404=43, srv820868051=89, srv1313892034=19, srv184056127=42, srv488626423=68, srv603117291=77, srv793821910=87, srv1672218601=36, srv1991798669=49, srv1528474527=28, srv1646913581=35, srv1263729722=17, srv897111627=93, srv870897713=91, srv1803719487=40, srv2105430438=53, srv422339779=63, srv883755957=92, srv116900654=12, srv1043245058=1, srv247555496=55, srv587808678=74, srv718797501=86, srv32527587=59, srv1336586180=20, srv1815544242=41, srv303364450=57, srv1444058524=24, srv313733966=58, srv1628521161=34, srv823985140=90, srv1242330091=14, srv1969198479=47, srv695818647=81, srv708431304=85, srv997925212=99, srv1353705596=22, srv196706029=46, srv105313650=3, srv684874002=79, srv703046622=83, srv678333295=78, srv1904343123=44, srv1352667330=21, srv1166501323=11, srv534904747=69, srv457763125=66, srv929404607=95, srv1253491344=16, srv704056076=84, srv109822682=6, srv2060664612=51, srv1062388771=4, srv1012272755=0, srv1189056621=13, srv1685976875=37, srv1553469062=29, srv591581070=75, srv1514476146=25, srv1280679840=18, srv2024233397=50, srv59899997=76, srv553324152=71, srv461422296=67, srv931368152=96, srv1442270318=23, srv389349741=61, srv536893141=70, srv455819833=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:53,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:53,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-06 03:58:53,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-06 03:58:53,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-06 03:58:53,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-06 03:58:53,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-06 03:58:53,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-06 03:58:53,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020483615429410466); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043690576125747935, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020483615429410466); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,473 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-06 03:58:53,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013626919665195691, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020483615429410466); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043690576125747935, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020483615429410466); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-06 03:58:53,629 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 239 ms to try 5000 different iterations.  Found a solution that moves 974 regions; Going from a computed imbalance of 0.013626919665195691 to a new imbalance of 6.62261009394944E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005536442993707366); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01301816050007973); MoveCostFunction : (multiplier=7.0, imbalance=0.10822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005536442993707366); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,630 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv422339779:82 , srv574127192:82 , srv897111627:82 , srv929404607:82 , srv931368152:82 , srv1045554879:83 , srv1166501323:83 , srv1527074530:83 , srv1528474527:83 , srv536893141:83 , srv105313650:84 , srv1081893947:84 , srv116900654:84 , srv1280679840:84 , srv1607303546:84 , srv1617386860:84 , srv1628400995:84 , srv1803719487:84 , srv1911023999:84 , srv1969198479:84 , srv488626423:84 , srv603117291:84 , srv703046622:84 , srv708431304:84 , srv793821910:84 , srv870897713:84 , srv883755957:84 , srv1043245058:85 , srv1109242625:85 , srv1120446726:85 , srv1248166255:85 , srv1313892034:85 , srv1352667330:85 , srv1353705596:85 , srv1442270318:85 , srv1888802404:85 , srv1991798669:85 , srv2060664612:85 , srv2086911112:85 , srv2105430438:85 , srv270832687:85 , srv313733966:85 , srv334829120:85 , srv457763125:85 , srv553324152:85 , srv684874002:85 , srv685425219:85 , srv702281033:85 , srv911930069:85 , srv987818054:85 , srv997925212:85 , srv1012272755:86 , srv1134490368:86 , srv1142060743:86 , srv1189056621:86 , srv1242330091:86 , srv1263729722:86 , srv1444058524:86 , srv1568100739:86 , srv1628521161:86 , srv1815544242:86 , srv1983427265:86 , srv247555496:86 , srv303364450:86 , srv32527587:86 , srv389349741:86 , srv405301698:86 , srv45447562:86 , srv455819833:86 , srv461422296:86 , srv534904747:86 , srv591581070:86 , srv678333295:86 , srv704056076:86 , srv823985140:86 , srv971610836:86 , srv1062388771:87 , srv109822682:87 , srv1253491344:87 , srv1336586180:87 , srv1514476146:87 , srv1526052392:87 , srv1646913581:87 , srv1672218601:87 , srv1685976875:87 , srv1734560824:87 , srv1744520115:87 , srv184056127:87 , srv1904343123:87 , srv196706029:87 , srv2024233397:87 , srv2131834598:87 , srv587808678:87 , srv820868051:87 , srv1553469062:88 , srv574355134:88 , srv695818647:88 , srv718797501:88 , srv807880765:88 , srv59899997:551 }
2023-11-06 03:58:53,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:53,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv574127192=72, srv807880765=88, srv911930069=94, srv1527074530=27, srv1983427265=48, srv1142060743=10, srv2131834598=54, srv1081893947=5, srv1134490368=9, srv1911023999=45, srv987818054=98, srv2086911112=52, srv1109242625=7, srv334829120=60, srv270832687=56, srv1628400995=33, srv1734560824=38, srv1526052392=26, srv685425219=80, srv1744520115=39, srv1607303546=31, srv1568100739=30, srv1120446726=8, srv1045554879=2, srv971610836=97, srv574355134=73, srv1248166255=15, srv1617386860=32, srv702281033=82, srv45447562=64, srv405301698=62, srv1888802404=43, srv820868051=89, srv1313892034=19, srv184056127=42, srv488626423=68, srv603117291=77, srv793821910=87, srv1672218601=36, srv1991798669=49, srv1528474527=28, srv1646913581=35, srv1263729722=17, srv897111627=93, srv870897713=91, srv1803719487=40, srv2105430438=53, srv422339779=63, srv883755957=92, srv116900654=12, srv1043245058=1, srv247555496=55, srv587808678=74, srv718797501=86, srv32527587=59, srv1336586180=20, srv1815544242=41, srv303364450=57, srv1444058524=24, srv313733966=58, srv1628521161=34, srv823985140=90, srv1242330091=14, srv1969198479=47, srv695818647=81, srv708431304=85, srv997925212=99, srv1353705596=22, srv196706029=46, srv105313650=3, srv684874002=79, srv703046622=83, srv678333295=78, srv1904343123=44, srv1352667330=21, srv1166501323=11, srv534904747=69, srv457763125=66, srv929404607=95, srv1253491344=16, srv704056076=84, srv109822682=6, srv2060664612=51, srv1062388771=4, srv1012272755=0, srv1189056621=13, srv1685976875=37, srv1553469062=29, srv591581070=75, srv1514476146=25, srv1280679840=18, srv2024233397=50, srv59899997=76, srv553324152=71, srv461422296=67, srv931368152=96, srv1442270318=23, srv389349741=61, srv536893141=70, srv455819833=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:53,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:53,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-06 03:58:53,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-06 03:58:53,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-06 03:58:53,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-06 03:58:53,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-06 03:58:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-06 03:58:53,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005536442993707366); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01301816050007973); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005536442993707366); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,739 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-06 03:58:53,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.55440915626157E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005536442993707366); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01301816050007973); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005536442993707366); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-06 03:58:53,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 330 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 6.55440915626157E-4 to a new imbalance of 3.150813589786856E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002721655269759087); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:53,985 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1336586180:82 , srv1353705596:83 , srv1646913581:83 , srv1744520115:83 , srv1012272755:84 , srv105313650:84 , srv1062388771:84 , srv1081893947:84 , srv109822682:84 , srv1120446726:84 , srv1134490368:84 , srv1142060743:84 , srv1166501323:84 , srv1189056621:84 , srv1242330091:84 , srv1280679840:84 , srv1313892034:84 , srv1514476146:84 , srv1527074530:84 , srv1568100739:84 , srv1685976875:84 , srv1734560824:84 , srv1888802404:84 , srv1904343123:84 , srv1969198479:84 , srv2060664612:84 , srv2131834598:84 , srv303364450:84 , srv313733966:84 , srv389349741:84 , srv405301698:84 , srv45447562:84 , srv488626423:84 , srv574355134:84 , srv684874002:84 , srv685425219:84 , srv695818647:84 , srv703046622:84 , srv708431304:84 , srv718797501:84 , srv793821910:84 , srv807880765:84 , srv820868051:84 , srv870897713:84 , srv883755957:84 , srv929404607:84 , srv987818054:84 , srv997925212:84 , srv1043245058:85 , srv1045554879:85 , srv1109242625:85 , srv116900654:85 , srv1248166255:85 , srv1253491344:85 , srv1263729722:85 , srv1444058524:85 , srv1526052392:85 , srv1528474527:85 , srv1553469062:85 , srv1607303546:85 , srv1617386860:85 , srv1628400995:85 , srv1628521161:85 , srv1672218601:85 , srv1803719487:85 , srv1815544242:85 , srv184056127:85 , srv1911023999:85 , srv196706029:85 , srv1983427265:85 , srv1991798669:85 , srv2086911112:85 , srv2105430438:85 , srv247555496:85 , srv270832687:85 , srv334829120:85 , srv422339779:85 , srv455819833:85 , srv457763125:85 , srv461422296:85 , srv534904747:85 , srv536893141:85 , srv553324152:85 , srv574127192:85 , srv587808678:85 , srv591581070:85 , srv603117291:85 , srv678333295:85 , srv702281033:85 , srv704056076:85 , srv823985140:85 , srv897111627:85 , srv911930069:85 , srv931368152:85 , srv971610836:85 , srv1352667330:86 , srv1442270318:86 , srv2024233397:86 , srv32527587:86 , srv59899997:634 }
2023-11-06 03:58:53,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:53,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv574127192=72, srv807880765=88, srv911930069=94, srv1527074530=27, srv1983427265=48, srv1142060743=10, srv2131834598=54, srv1081893947=5, srv1134490368=9, srv1911023999=45, srv987818054=98, srv2086911112=52, srv1109242625=7, srv334829120=60, srv270832687=56, srv1628400995=33, srv1734560824=38, srv1526052392=26, srv685425219=80, srv1744520115=39, srv1607303546=31, srv1568100739=30, srv1120446726=8, srv1045554879=2, srv971610836=97, srv574355134=73, srv1248166255=15, srv1617386860=32, srv702281033=82, srv45447562=64, srv405301698=62, srv1888802404=43, srv820868051=89, srv1313892034=19, srv184056127=42, srv488626423=68, srv603117291=77, srv793821910=87, srv1672218601=36, srv1991798669=49, srv1528474527=28, srv1646913581=35, srv1263729722=17, srv897111627=93, srv870897713=91, srv1803719487=40, srv2105430438=53, srv422339779=63, srv883755957=92, srv116900654=12, srv1043245058=1, srv247555496=55, srv587808678=74, srv718797501=86, srv32527587=59, srv1336586180=20, srv1815544242=41, srv303364450=57, srv1444058524=24, srv313733966=58, srv1628521161=34, srv823985140=90, srv1242330091=14, srv1969198479=47, srv695818647=81, srv708431304=85, srv997925212=99, srv1353705596=22, srv196706029=46, srv105313650=3, srv684874002=79, srv703046622=83, srv678333295=78, srv1904343123=44, srv1352667330=21, srv1166501323=11, srv534904747=69, srv457763125=66, srv929404607=95, srv1253491344=16, srv704056076=84, srv109822682=6, srv2060664612=51, srv1062388771=4, srv1012272755=0, srv1189056621=13, srv1685976875=37, srv1553469062=29, srv591581070=75, srv1514476146=25, srv1280679840=18, srv2024233397=50, srv59899997=76, srv553324152=71, srv461422296=67, srv931368152=96, srv1442270318=23, srv389349741=61, srv536893141=70, srv455819833=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:53,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:53,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-06 03:58:54,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-06 03:58:54,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-06 03:58:54,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-06 03:58:54,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-06 03:58:54,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-06 03:58:54,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-06 03:58:54,087 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002721655269759087); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:54,087 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-06 03:58:54,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.9778604931861993E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002721655269759087); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-06 03:58:54,251 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 238 ms to try 5000 different iterations.  Found a solution that moves 45 regions; Going from a computed imbalance of 2.9778604931861993E-5 to a new imbalance of 7.70285423501011E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.005); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:54,252 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1352667330:83 , srv1442270318:83 , srv1526052392:83 , srv1553469062:83 , srv196706029:83 , srv2024233397:83 , srv534904747:83 , srv587808678:83 , srv603117291:83 , srv702281033:83 , srv823985140:83 , srv1012272755:84 , srv1043245058:84 , srv1045554879:84 , srv105313650:84 , srv1062388771:84 , srv1081893947:84 , srv109822682:84 , srv1109242625:84 , srv1134490368:84 , srv1142060743:84 , srv116900654:84 , srv1189056621:84 , srv1242330091:84 , srv1248166255:84 , srv1253491344:84 , srv1263729722:84 , srv1280679840:84 , srv1313892034:84 , srv1353705596:84 , srv1444058524:84 , srv1514476146:84 , srv1528474527:84 , srv1568100739:84 , srv1607303546:84 , srv1617386860:84 , srv1628400995:84 , srv1628521161:84 , srv1672218601:84 , srv1685976875:84 , srv1734560824:84 , srv1744520115:84 , srv1803719487:84 , srv1815544242:84 , srv184056127:84 , srv1888802404:84 , srv1904343123:84 , srv1911023999:84 , srv1969198479:84 , srv1983427265:84 , srv1991798669:84 , srv2060664612:84 , srv2086911112:84 , srv2105430438:84 , srv2131834598:84 , srv247555496:84 , srv270832687:84 , srv303364450:84 , srv313733966:84 , srv32527587:84 , srv334829120:84 , srv389349741:84 , srv405301698:84 , srv422339779:84 , srv455819833:84 , srv457763125:84 , srv461422296:84 , srv536893141:84 , srv553324152:84 , srv574127192:84 , srv574355134:84 , srv591581070:84 , srv678333295:84 , srv684874002:84 , srv695818647:84 , srv703046622:84 , srv704056076:84 , srv708431304:84 , srv718797501:84 , srv807880765:84 , srv820868051:84 , srv870897713:84 , srv897111627:84 , srv911930069:84 , srv929404607:84 , srv931368152:84 , srv971610836:84 , srv987818054:84 , srv997925212:84 , srv1120446726:85 , srv1166501323:85 , srv1336586180:85 , srv1527074530:85 , srv1646913581:85 , srv45447562:85 , srv488626423:85 , srv685425219:85 , srv793821910:85 , srv883755957:85 , srv59899997:685 }
2023-11-06 03:58:54,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:54,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv574127192=72, srv807880765=88, srv911930069=94, srv1527074530=27, srv1983427265=48, srv1142060743=10, srv2131834598=54, srv1081893947=5, srv1134490368=9, srv1911023999=45, srv987818054=98, srv2086911112=52, srv1109242625=7, srv334829120=60, srv270832687=56, srv1628400995=33, srv1734560824=38, srv1526052392=26, srv685425219=80, srv1744520115=39, srv1607303546=31, srv1568100739=30, srv1120446726=8, srv1045554879=2, srv971610836=97, srv574355134=73, srv1248166255=15, srv1617386860=32, srv702281033=82, srv45447562=64, srv405301698=62, srv1888802404=43, srv820868051=89, srv1313892034=19, srv184056127=42, srv488626423=68, srv603117291=77, srv793821910=87, srv1672218601=36, srv1991798669=49, srv1528474527=28, srv1646913581=35, srv1263729722=17, srv897111627=93, srv870897713=91, srv1803719487=40, srv2105430438=53, srv422339779=63, srv883755957=92, srv116900654=12, srv1043245058=1, srv247555496=55, srv587808678=74, srv718797501=86, srv32527587=59, srv1336586180=20, srv1815544242=41, srv303364450=57, srv1444058524=24, srv313733966=58, srv1628521161=34, srv823985140=90, srv1242330091=14, srv1969198479=47, srv695818647=81, srv708431304=85, srv997925212=99, srv1353705596=22, srv196706029=46, srv105313650=3, srv684874002=79, srv703046622=83, srv678333295=78, srv1904343123=44, srv1352667330=21, srv1166501323=11, srv534904747=69, srv457763125=66, srv929404607=95, srv1253491344=16, srv704056076=84, srv109822682=6, srv2060664612=51, srv1062388771=4, srv1012272755=0, srv1189056621=13, srv1685976875=37, srv1553469062=29, srv591581070=75, srv1514476146=25, srv1280679840=18, srv2024233397=50, srv59899997=76, srv553324152=71, srv461422296=67, srv931368152=96, srv1442270318=23, srv389349741=61, srv536893141=70, srv455819833=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:54,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:54,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-06 03:58:54,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-06 03:58:54,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-06 03:58:54,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-06 03:58:54,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-06 03:58:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-06 03:58:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-06 03:58:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-06 03:58:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-06 03:58:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-06 03:58:54,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-06 03:58:54,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:54,362 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1352667330:83 , srv1442270318:83 , srv1526052392:83 , srv1553469062:83 , srv196706029:83 , srv2024233397:83 , srv534904747:83 , srv587808678:83 , srv603117291:83 , srv702281033:83 , srv823985140:83 , srv1012272755:84 , srv1043245058:84 , srv1045554879:84 , srv105313650:84 , srv1062388771:84 , srv1081893947:84 , srv109822682:84 , srv1109242625:84 , srv1134490368:84 , srv1142060743:84 , srv116900654:84 , srv1189056621:84 , srv1242330091:84 , srv1248166255:84 , srv1253491344:84 , srv1263729722:84 , srv1280679840:84 , srv1313892034:84 , srv1353705596:84 , srv1444058524:84 , srv1514476146:84 , srv1528474527:84 , srv1568100739:84 , srv1607303546:84 , srv1617386860:84 , srv1628400995:84 , srv1628521161:84 , srv1672218601:84 , srv1685976875:84 , srv1734560824:84 , srv1744520115:84 , srv1803719487:84 , srv1815544242:84 , srv184056127:84 , srv1888802404:84 , srv1904343123:84 , srv1911023999:84 , srv1969198479:84 , srv1983427265:84 , srv1991798669:84 , srv2060664612:84 , srv2086911112:84 , srv2105430438:84 , srv2131834598:84 , srv247555496:84 , srv270832687:84 , srv303364450:84 , srv313733966:84 , srv32527587:84 , srv334829120:84 , srv389349741:84 , srv405301698:84 , srv422339779:84 , srv455819833:84 , srv457763125:84 , srv461422296:84 , srv536893141:84 , srv553324152:84 , srv574127192:84 , srv574355134:84 , srv591581070:84 , srv678333295:84 , srv684874002:84 , srv695818647:84 , srv703046622:84 , srv704056076:84 , srv708431304:84 , srv718797501:84 , srv807880765:84 , srv820868051:84 , srv870897713:84 , srv897111627:84 , srv911930069:84 , srv929404607:84 , srv931368152:84 , srv971610836:84 , srv987818054:84 , srv997925212:84 , srv1120446726:85 , srv1166501323:85 , srv1336586180:85 , srv1527074530:85 , srv1646913581:85 , srv45447562:85 , srv488626423:85 , srv685425219:85 , srv793821910:85 , srv883755957:85 , srv59899997:685 }
2023-11-06 03:58:54,384 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=458 (was 454) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=10828 (was 11281)
2023-11-06 03:58:54,393 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=458, ProcessCount=166, AvailableMemoryMB=10828
2023-11-06 03:58:54,393 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-06 03:58:54,393 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-06 03:58:54,403 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1056834150:84 , srv1104131876:84 , srv1168668958:84 , srv1199956291:84 , srv1286095644:84 , srv1365208290:84 , srv140118358:84 , srv1465423637:84 , srv1721066362:84 , srv186434683:84 , srv1874651149:84 , srv1878652180:84 , srv1931119916:84 , srv2030541737:84 , srv2069394436:84 , srv22691522:84 , srv292934719:84 , srv323824226:84 , srv418709287:84 , srv421344580:84 , srv464530502:84 , srv512302396:84 , srv623435998:84 , srv664034597:84 , srv665362505:84 , srv742769726:84 , srv748020649:84 , srv803995610:84 , srv848312556:84 , srv1849324717:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-06 03:58:54,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 03:58:54,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv418709287=19, srv2030541737=14, srv512302396=22, srv1286095644=4, srv848312556=29, srv623435998=23, srv803995610=28, srv1104131876=1, srv742769726=26, srv1465423637=7, srv22691522=16, srv2069394436=15, srv421344580=20, srv186434683=10, srv292934719=17, srv1199956291=3, srv1056834150=0, srv1168668958=2, srv1849324717=9, srv665362505=25, srv1931119916=13, srv1365208290=5, srv1874651149=11, srv1721066362=8, srv1878652180=12, srv323824226=18, srv748020649=27, srv140118358=6, srv664034597=24, srv464530502=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 03:58:54,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 03:58:54,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 03:58:54,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 03:58:54,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 03:58:54,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 03:58:54,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 03:58:54,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-06 03:58:54,436 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1786747449082307, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 03:58:54,437 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912756041551217, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1786747449082307, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-06 04:00:54,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9533343 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912756041551217 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 04:00:54,425 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1056834150:90 , srv1104131876:90 , srv1168668958:90 , srv1199956291:90 , srv1286095644:90 , srv1365208290:90 , srv140118358:90 , srv1465423637:90 , srv1721066362:90 , srv1849324717:90 , srv186434683:90 , srv1874651149:90 , srv1878652180:90 , srv1931119916:90 , srv2030541737:90 , srv2069394436:90 , srv22691522:90 , srv292934719:90 , srv323824226:90 , srv418709287:90 , srv421344580:90 , srv464530502:90 , srv512302396:90 , srv623435998:90 , srv664034597:90 , srv665362505:90 , srv742769726:90 , srv748020649:90 , srv803995610:90 , srv848312556:90 }
2023-11-06 04:00:54,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-06 04:00:54,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv418709287=19, srv2030541737=14, srv512302396=22, srv1286095644=4, srv848312556=29, srv623435998=23, srv803995610=28, srv1104131876=1, srv742769726=26, srv1465423637=7, srv22691522=16, srv2069394436=15, srv421344580=20, srv186434683=10, srv292934719=17, srv1199956291=3, srv1056834150=0, srv1168668958=2, srv1849324717=9, srv665362505=25, srv1931119916=13, srv1365208290=5, srv1874651149=11, srv1721066362=8, srv1878652180=12, srv323824226=18, srv748020649=27, srv140118358=6, srv664034597=24, srv464530502=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-06 04:00:54,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-06 04:00:54,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-06 04:00:54,442 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-06 04:00:54,442 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1056834150:90 , srv1104131876:90 , srv1168668958:90 , srv1199956291:90 , srv1286095644:90 , srv1365208290:90 , srv140118358:90 , srv1465423637:90 , srv1721066362:90 , srv1849324717:90 , srv186434683:90 , srv1874651149:90 , srv1878652180:90 , srv1931119916:90 , srv2030541737:90 , srv2069394436:90 , srv22691522:90 , srv292934719:90 , srv323824226:90 , srv418709287:90 , srv421344580:90 , srv464530502:90 , srv512302396:90 , srv623435998:90 , srv664034597:90 , srv665362505:90 , srv742769726:90 , srv748020649:90 , srv803995610:90 , srv848312556:90 }
2023-11-06 04:00:54,457 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 458), ProcessCount=166 (was 166), AvailableMemoryMB=10886 (was 10828) - AvailableMemoryMB LEAK? -