2023-07-17 21:53:10,532 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-17 21:53:10,858 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-17 21:53:10,971 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-17 21:53:11,043 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-17 21:53:11,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-17 21:53:11,064 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=173, AvailableMemoryMB=7727
2023-07-17 21:53:11,066 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-17 21:53:11,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-17 21:53:11,235 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1015370426:84 , srv1037732481:84 , srv1041226655:84 , srv1041257924:84 , srv1050424105:84 , srv1127046310:84 , srv1131405217:84 , srv1136239908:84 , srv1144639620:84 , srv116019036:84 , srv1160903033:84 , srv1175312762:84 , srv1182351455:84 , srv1239383484:84 , srv1247549551:84 , srv1268037597:84 , srv1271829642:84 , srv128692585:84 , srv1288064744:84 , srv1288601882:84 , srv1362030058:84 , srv13693009:84 , srv1370852641:84 , srv1395264928:84 , srv1418776450:84 , srv1420811511:84 , srv1434495727:84 , srv1434866513:84 , srv1528720747:84 , srv1536102285:84 , srv1544475910:84 , srv1605077493:84 , srv1607306466:84 , srv1613351908:84 , srv1616597941:84 , srv1618073031:84 , srv1623608314:84 , srv1629380347:84 , srv1641307551:84 , srv1642628948:84 , srv1651126146:84 , srv1673246548:84 , srv1702377327:84 , srv174019963:84 , srv1750382817:84 , srv177354498:84 , srv1774300138:84 , srv1838323368:84 , srv1841500497:84 , srv1850937641:84 , srv1852118025:84 , srv1868218365:84 , srv1897633041:84 , srv1934571877:84 , srv193573761:84 , srv2115661562:84 , srv224644260:84 , srv234610843:84 , srv248684446:84 , srv28414855:84 , srv321472723:84 , srv321771918:84 , srv32609393:84 , srv332150127:84 , srv332464491:84 , srv344226952:84 , srv384809107:84 , srv385756803:84 , srv389985277:84 , srv417196448:84 , srv425756880:84 , srv437047810:84 , srv444487468:84 , srv450289883:84 , srv45257472:84 , srv47876865:84 , srv49188137:84 , srv503708710:84 , srv50493800:84 , srv516117031:84 , srv546854236:84 , srv548663251:84 , srv61027136:84 , srv66532088:84 , srv692829312:84 , srv708751145:84 , srv711758867:84 , srv732934706:84 , srv751767828:84 , srv755449415:84 , srv791817815:84 , srv803384932:84 , srv808721480:84 , srv871514710:84 , srv940025376:84 , srv95034569:84 , srv96809168:84 , srv975444258:84 , srv981763205:84 , srv1786314031:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-17 21:53:11,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:53:11,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420811511=25, srv95034569=96, srv708751145=86, srv28414855=60, srv1395264928=23, srv1015370426=0, srv1037732481=1, srv1041257924=3, srv1651126146=40, srv1605077493=31, srv732934706=88, srv234610843=58, srv1247549551=14, srv1702377327=42, srv1618073031=35, srv389985277=69, srv516117031=80, srv248684446=59, srv1850937641=50, srv32609393=63, srv1418776450=24, srv1144639620=8, srv1934571877=54, srv1536102285=29, srv1841500497=49, srv1288601882=19, srv1868218365=52, srv116019036=9, srv49188137=77, srv45257472=75, srv1136239908=7, srv444487468=73, srv13693009=21, srv1544475910=30, srv384809107=67, srv193573761=55, srv1629380347=37, srv692829312=85, srv1239383484=13, srv808721480=93, srv417196448=70, srv321472723=61, srv47876865=76, srv548663251=82, srv1623608314=36, srv1362030058=20, srv321771918=62, srv1613351908=33, srv66532088=84, srv546854236=81, srv1774300138=46, srv1616597941=34, srv61027136=83, srv1370852641=22, srv177354498=45, srv1434866513=27, srv1641307551=38, srv1838323368=48, srv1434495727=26, srv385756803=68, srv1160903033=10, srv755449415=90, srv332464491=65, srv1673246548=41, srv981763205=99, srv1127046310=5, srv1750382817=44, srv450289883=74, srv1607306466=32, srv1271829642=16, srv803384932=92, srv1175312762=11, srv344226952=66, srv791817815=91, srv50493800=79, srv503708710=78, srv1131405217=6, srv1288064744=18, srv751767828=89, srv1642628948=39, srv425756880=71, srv1050424105=4, srv437047810=72, srv975444258=98, srv1786314031=47, srv96809168=97, srv871514710=94, srv1897633041=53, srv1268037597=15, srv711758867=87, srv1528720747=28, srv224644260=57, srv174019963=43, srv1041226655=2, srv128692585=17, srv2115661562=56, srv332150127=64, srv1182351455=12, srv940025376=95, srv1852118025=51} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:53:11,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:53:11,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:53:11,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:53:11,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:53:11,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:53:11,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:53:11,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:53:11,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:53:11,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:53:11,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:53:11,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:53:11,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:53:11,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:53:11,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:53:11,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:53:11,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:53:11,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:53:11,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:53:11,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:53:11,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:53:11,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:53:11,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:53:11,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:53:11,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:53:11,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 21:53:11,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 21:53:11,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 21:53:11,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 21:53:11,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 21:53:11,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 21:53:11,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 21:53:11,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 21:53:11,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 21:53:11,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 21:53:11,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 21:53:11,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 21:53:11,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 21:53:11,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 21:53:11,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 21:53:11,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 21:53:11,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 21:53:11,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 21:53:11,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 21:53:11,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 21:53:11,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 21:53:11,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 21:53:11,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 21:53:11,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 21:53:11,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 21:53:11,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 21:53:11,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 21:53:11,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 21:53:11,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:11,601 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 21:53:11,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 21:53:12,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1146 ms to try 5000 different iterations.  Found a solution that moves 4658 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18201509589256346. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0396263254231573, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05406900026931751, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5175555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0396263254231573, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:12,600 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1651126146:81 , srv444487468:82 , srv1037732481:83 , srv1528720747:83 , srv1544475910:83 , srv417196448:83 , srv516117031:83 , srv546854236:83 , srv751767828:83 , srv871514710:83 , srv1271829642:84 , srv1288064744:84 , srv1370852641:84 , srv1418776450:84 , srv1536102285:84 , srv1750382817:84 , srv1774300138:84 , srv1850937641:84 , srv1852118025:84 , srv2115661562:84 , srv321771918:84 , srv975444258:84 , srv1015370426:85 , srv1041226655:85 , srv1127046310:85 , srv1131405217:85 , srv1247549551:85 , srv1629380347:85 , srv1838323368:85 , srv1868218365:85 , srv1897633041:85 , srv234610843:85 , srv332150127:85 , srv332464491:85 , srv384809107:85 , srv425756880:85 , srv437047810:85 , srv548663251:85 , srv803384932:85 , srv808721480:85 , srv95034569:85 , srv1050424105:86 , srv116019036:86 , srv1182351455:86 , srv13693009:86 , srv1434495727:86 , srv1605077493:86 , srv1607306466:86 , srv1613351908:86 , srv1616597941:86 , srv1618073031:86 , srv1623608314:86 , srv1641307551:86 , srv177354498:86 , srv385756803:86 , srv389985277:86 , srv50493800:86 , srv61027136:86 , srv692829312:86 , srv708751145:86 , srv755449415:86 , srv96809168:86 , srv1395264928:87 , srv1702377327:87 , srv174019963:87 , srv1934571877:87 , srv344226952:87 , srv450289883:87 , srv45257472:87 , srv711758867:87 , srv732934706:87 , srv981763205:87 , srv1041257924:88 , srv1362030058:88 , srv1420811511:88 , srv1434866513:88 , srv1673246548:88 , srv1841500497:88 , srv193573761:88 , srv1144639620:89 , srv1268037597:89 , srv1642628948:89 , srv32609393:89 , srv47876865:89 , srv49188137:89 , srv1136239908:90 , srv128692585:90 , srv28414855:90 , srv321472723:90 , srv503708710:90 , srv66532088:90 , srv1239383484:91 , srv1288601882:91 , srv791817815:91 , srv940025376:91 , srv1160903033:92 , srv248684446:92 , srv1175312762:97 , srv224644260:97 , srv1786314031:442 }
2023-07-17 21:53:12,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:53:12,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420811511=25, srv95034569=96, srv708751145=86, srv28414855=60, srv1395264928=23, srv1015370426=0, srv1037732481=1, srv1041257924=3, srv1651126146=40, srv1605077493=31, srv732934706=88, srv234610843=58, srv1247549551=14, srv1702377327=42, srv1618073031=35, srv389985277=69, srv516117031=80, srv248684446=59, srv1850937641=50, srv32609393=63, srv1418776450=24, srv1144639620=8, srv1934571877=54, srv1536102285=29, srv1841500497=49, srv1288601882=19, srv1868218365=52, srv116019036=9, srv49188137=77, srv45257472=75, srv1136239908=7, srv444487468=73, srv13693009=21, srv1544475910=30, srv384809107=67, srv193573761=55, srv1629380347=37, srv692829312=85, srv1239383484=13, srv808721480=93, srv417196448=70, srv321472723=61, srv47876865=76, srv548663251=82, srv1623608314=36, srv1362030058=20, srv321771918=62, srv1613351908=33, srv66532088=84, srv546854236=81, srv1774300138=46, srv1616597941=34, srv61027136=83, srv1370852641=22, srv177354498=45, srv1434866513=27, srv1641307551=38, srv1838323368=48, srv1434495727=26, srv385756803=68, srv1160903033=10, srv755449415=90, srv332464491=65, srv1673246548=41, srv981763205=99, srv1127046310=5, srv1750382817=44, srv450289883=74, srv1607306466=32, srv1271829642=16, srv803384932=92, srv1175312762=11, srv344226952=66, srv791817815=91, srv50493800=79, srv503708710=78, srv1131405217=6, srv1288064744=18, srv751767828=89, srv1642628948=39, srv425756880=71, srv1050424105=4, srv437047810=72, srv975444258=98, srv1786314031=47, srv96809168=97, srv871514710=94, srv1897633041=53, srv1268037597=15, srv711758867=87, srv1528720747=28, srv224644260=57, srv174019963=43, srv1041226655=2, srv128692585=17, srv2115661562=56, srv332150127=64, srv1182351455=12, srv940025376=95, srv1852118025=51} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:53:12,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:53:12,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:53:12,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:53:12,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 21:53:12,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 21:53:12,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 21:53:12,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 21:53:12,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 21:53:12,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 21:53:12,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 21:53:12,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 21:53:12,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 21:53:12,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 21:53:12,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 21:53:12,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 21:53:12,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 21:53:12,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 21:53:12,839 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0396263254231573, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05406900026931751, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0396263254231573, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:12,839 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 21:53:12,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18198247987944743, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0396263254231573, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05406900026931751, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0396263254231573, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 21:53:13,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 595 ms to try 5000 different iterations.  Found a solution that moves 2644 regions; Going from a computed imbalance of 0.18198247987944743 to a new imbalance of 0.014710761811585607. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020371900768957882); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032143756779315115, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2937777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020371900768957882); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:13,284 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1175312762:75 , srv224644260:75 , srv1136239908:80 , srv321472723:80 , srv1160903033:81 , srv1642628948:81 , srv28414855:81 , srv1144639620:82 , srv1239383484:82 , srv1288601882:82 , srv248684446:82 , srv47876865:82 , srv49188137:82 , srv791817815:82 , srv940025376:82 , srv1268037597:83 , srv1420811511:83 , srv1841500497:83 , srv193573761:83 , srv503708710:83 , srv116019036:84 , srv1434866513:84 , srv174019963:84 , srv1934571877:84 , srv711758867:84 , srv732934706:84 , srv981763205:84 , srv1050424105:85 , srv128692585:85 , srv1362030058:85 , srv1395264928:85 , srv1434495727:85 , srv1618073031:85 , srv177354498:85 , srv344226952:85 , srv385756803:85 , srv450289883:85 , srv50493800:85 , srv692829312:85 , srv755449415:85 , srv96809168:85 , srv1041257924:86 , srv1182351455:86 , srv1613351908:86 , srv1673246548:86 , srv1702377327:86 , srv1838323368:86 , srv1850937641:86 , srv1868218365:86 , srv234610843:86 , srv32609393:86 , srv384809107:86 , srv389985277:86 , srv45257472:86 , srv548663251:86 , srv61027136:86 , srv1015370426:87 , srv1127046310:87 , srv1247549551:87 , srv13693009:87 , srv1418776450:87 , srv1544475910:87 , srv1607306466:87 , srv1616597941:87 , srv1623608314:87 , srv1629380347:87 , srv1852118025:87 , srv1897633041:87 , srv66532088:87 , srv808721480:87 , srv975444258:87 , srv1041226655:88 , srv1370852641:88 , srv1605077493:88 , srv1750382817:88 , srv1774300138:88 , srv425756880:88 , srv437047810:88 , srv516117031:88 , srv803384932:88 , srv871514710:88 , srv95034569:88 , srv1037732481:89 , srv1131405217:89 , srv1271829642:89 , srv1288064744:89 , srv1528720747:89 , srv1536102285:89 , srv321771918:89 , srv332150127:89 , srv332464491:89 , srv417196448:89 , srv1641307551:90 , srv444487468:90 , srv546854236:90 , srv708751145:90 , srv751767828:90 , srv1651126146:91 , srv2115661562:91 , srv1786314031:513 }
2023-07-17 21:53:13,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:53:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420811511=25, srv95034569=96, srv708751145=86, srv28414855=60, srv1395264928=23, srv1015370426=0, srv1037732481=1, srv1041257924=3, srv1651126146=40, srv1605077493=31, srv732934706=88, srv234610843=58, srv1247549551=14, srv1702377327=42, srv1618073031=35, srv389985277=69, srv516117031=80, srv248684446=59, srv1850937641=50, srv32609393=63, srv1418776450=24, srv1144639620=8, srv1934571877=54, srv1536102285=29, srv1841500497=49, srv1288601882=19, srv1868218365=52, srv116019036=9, srv49188137=77, srv45257472=75, srv1136239908=7, srv444487468=73, srv13693009=21, srv1544475910=30, srv384809107=67, srv193573761=55, srv1629380347=37, srv692829312=85, srv1239383484=13, srv808721480=93, srv417196448=70, srv321472723=61, srv47876865=76, srv548663251=82, srv1623608314=36, srv1362030058=20, srv321771918=62, srv1613351908=33, srv66532088=84, srv546854236=81, srv1774300138=46, srv1616597941=34, srv61027136=83, srv1370852641=22, srv177354498=45, srv1434866513=27, srv1641307551=38, srv1838323368=48, srv1434495727=26, srv385756803=68, srv1160903033=10, srv755449415=90, srv332464491=65, srv1673246548=41, srv981763205=99, srv1127046310=5, srv1750382817=44, srv450289883=74, srv1607306466=32, srv1271829642=16, srv803384932=92, srv1175312762=11, srv344226952=66, srv791817815=91, srv50493800=79, srv503708710=78, srv1131405217=6, srv1288064744=18, srv751767828=89, srv1642628948=39, srv425756880=71, srv1050424105=4, srv437047810=72, srv975444258=98, srv1786314031=47, srv96809168=97, srv871514710=94, srv1897633041=53, srv1268037597=15, srv711758867=87, srv1528720747=28, srv224644260=57, srv174019963=43, srv1041226655=2, srv128692585=17, srv2115661562=56, srv332150127=64, srv1182351455=12, srv940025376=95, srv1852118025=51} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:53:13,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:53:13,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:53:13,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:53:13,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:53:13,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:53:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 21:53:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 21:53:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 21:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 21:53:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 21:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 21:53:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 21:53:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 21:53:13,446 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020371900768957882); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032143756779315115, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020371900768957882); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:13,446 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 21:53:13,447 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014692248127884711, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020371900768957882); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032143756779315115, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020371900768957882); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0115); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 21:53:13,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 416 ms to try 5000 different iterations.  Found a solution that moves 1028 regions; Going from a computed imbalance of 0.014692248127884711 to a new imbalance of 8.246373805740907E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003562983262925433); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007784989441615229); MoveCostFunction : (multiplier=7.0, imbalance=0.11422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003562983262925433); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:13,746 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv708751145:81 , srv32609393:82 , srv66532088:82 , srv1041257924:83 , srv128692585:83 , srv1641307551:83 , srv2115661562:83 , srv332464491:83 , srv1131405217:84 , srv1271829642:84 , srv1362030058:84 , srv1605077493:84 , srv1623608314:84 , srv1673246548:84 , srv248684446:84 , srv332150127:84 , srv437047810:84 , srv45257472:84 , srv803384932:84 , srv1037732481:85 , srv1041226655:85 , srv1050424105:85 , srv1160903033:85 , srv1182351455:85 , srv1239383484:85 , srv1247549551:85 , srv1268037597:85 , srv1288064744:85 , srv1288601882:85 , srv13693009:85 , srv1434866513:85 , srv1536102285:85 , srv1607306466:85 , srv1651126146:85 , srv1750382817:85 , srv1774300138:85 , srv224644260:85 , srv321771918:85 , srv389985277:85 , srv425756880:85 , srv444487468:85 , srv450289883:85 , srv503708710:85 , srv751767828:85 , srv791817815:85 , srv940025376:85 , srv95034569:85 , srv1015370426:86 , srv1127046310:86 , srv1175312762:86 , srv1370852641:86 , srv1395264928:86 , srv1418776450:86 , srv1420811511:86 , srv1434495727:86 , srv1528720747:86 , srv1613351908:86 , srv1616597941:86 , srv1702377327:86 , srv174019963:86 , srv177354498:86 , srv1852118025:86 , srv1868218365:86 , srv1897633041:86 , srv1934571877:86 , srv28414855:86 , srv344226952:86 , srv384809107:86 , srv385756803:86 , srv417196448:86 , srv50493800:86 , srv516117031:86 , srv546854236:86 , srv61027136:86 , srv808721480:86 , srv871514710:86 , srv96809168:86 , srv975444258:86 , srv981763205:86 , srv1144639620:87 , srv116019036:87 , srv1618073031:87 , srv1629380347:87 , srv1841500497:87 , srv1850937641:87 , srv47876865:87 , srv49188137:87 , srv548663251:87 , srv692829312:87 , srv711758867:87 , srv732934706:87 , srv755449415:87 , srv1544475910:88 , srv1838323368:88 , srv193573761:88 , srv234610843:88 , srv1136239908:89 , srv1642628948:89 , srv321472723:89 , srv1786314031:534 }
2023-07-17 21:53:13,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:53:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420811511=25, srv95034569=96, srv708751145=86, srv28414855=60, srv1395264928=23, srv1015370426=0, srv1037732481=1, srv1041257924=3, srv1651126146=40, srv1605077493=31, srv732934706=88, srv234610843=58, srv1247549551=14, srv1702377327=42, srv1618073031=35, srv389985277=69, srv516117031=80, srv248684446=59, srv1850937641=50, srv32609393=63, srv1418776450=24, srv1144639620=8, srv1934571877=54, srv1536102285=29, srv1841500497=49, srv1288601882=19, srv1868218365=52, srv116019036=9, srv49188137=77, srv45257472=75, srv1136239908=7, srv444487468=73, srv13693009=21, srv1544475910=30, srv384809107=67, srv193573761=55, srv1629380347=37, srv692829312=85, srv1239383484=13, srv808721480=93, srv417196448=70, srv321472723=61, srv47876865=76, srv548663251=82, srv1623608314=36, srv1362030058=20, srv321771918=62, srv1613351908=33, srv66532088=84, srv546854236=81, srv1774300138=46, srv1616597941=34, srv61027136=83, srv1370852641=22, srv177354498=45, srv1434866513=27, srv1641307551=38, srv1838323368=48, srv1434495727=26, srv385756803=68, srv1160903033=10, srv755449415=90, srv332464491=65, srv1673246548=41, srv981763205=99, srv1127046310=5, srv1750382817=44, srv450289883=74, srv1607306466=32, srv1271829642=16, srv803384932=92, srv1175312762=11, srv344226952=66, srv791817815=91, srv50493800=79, srv503708710=78, srv1131405217=6, srv1288064744=18, srv751767828=89, srv1642628948=39, srv425756880=71, srv1050424105=4, srv437047810=72, srv975444258=98, srv1786314031=47, srv96809168=97, srv871514710=94, srv1897633041=53, srv1268037597=15, srv711758867=87, srv1528720747=28, srv224644260=57, srv174019963=43, srv1041226655=2, srv128692585=17, srv2115661562=56, srv332150127=64, srv1182351455=12, srv940025376=95, srv1852118025=51} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 21:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 21:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 21:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 21:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 21:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 21:53:13,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003562983262925433); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007784989441615229); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003562983262925433); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:13,912 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 21:53:13,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.174391707236666E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003562983262925433); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007784989441615229); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003562983262925433); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 21:53:14,186 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 384 ms to try 5000 different iterations.  Found a solution that moves 233 regions; Going from a computed imbalance of 8.174391707236666E-4 to a new imbalance of 1.881435797756174E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.02588888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:14,187 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1136239908:82 , srv1702377327:82 , srv1605077493:83 , srv1616597941:83 , srv1629380347:83 , srv1641307551:83 , srv1642628948:83 , srv1838323368:83 , srv193573761:83 , srv234610843:83 , srv321472723:83 , srv546854236:83 , srv66532088:83 , srv1015370426:84 , srv1041226655:84 , srv1127046310:84 , srv1131405217:84 , srv1144639620:84 , srv1160903033:84 , srv1175312762:84 , srv1239383484:84 , srv128692585:84 , srv1288064744:84 , srv1288601882:84 , srv13693009:84 , srv1370852641:84 , srv1395264928:84 , srv1528720747:84 , srv1536102285:84 , srv1544475910:84 , srv1607306466:84 , srv1613351908:84 , srv1618073031:84 , srv1673246548:84 , srv1841500497:84 , srv1897633041:84 , srv2115661562:84 , srv248684446:84 , srv321771918:84 , srv344226952:84 , srv384809107:84 , srv389985277:84 , srv417196448:84 , srv425756880:84 , srv47876865:84 , srv49188137:84 , srv503708710:84 , srv548663251:84 , srv61027136:84 , srv692829312:84 , srv711758867:84 , srv732934706:84 , srv751767828:84 , srv755449415:84 , srv791817815:84 , srv808721480:84 , srv940025376:84 , srv1037732481:85 , srv1041257924:85 , srv116019036:85 , srv1182351455:85 , srv1247549551:85 , srv1268037597:85 , srv1362030058:85 , srv1418776450:85 , srv1420811511:85 , srv1434495727:85 , srv1434866513:85 , srv1623608314:85 , srv1651126146:85 , srv174019963:85 , srv1750382817:85 , srv177354498:85 , srv1774300138:85 , srv1850937641:85 , srv1852118025:85 , srv1868218365:85 , srv1934571877:85 , srv28414855:85 , srv32609393:85 , srv332150127:85 , srv332464491:85 , srv385756803:85 , srv437047810:85 , srv444487468:85 , srv450289883:85 , srv45257472:85 , srv50493800:85 , srv708751145:85 , srv803384932:85 , srv871514710:85 , srv95034569:85 , srv96809168:85 , srv975444258:85 , srv981763205:85 , srv1050424105:86 , srv1271829642:86 , srv224644260:86 , srv516117031:86 , srv1786314031:653 }
2023-07-17 21:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1420811511=25, srv95034569=96, srv708751145=86, srv28414855=60, srv1395264928=23, srv1015370426=0, srv1037732481=1, srv1041257924=3, srv1651126146=40, srv1605077493=31, srv732934706=88, srv234610843=58, srv1247549551=14, srv1702377327=42, srv1618073031=35, srv389985277=69, srv516117031=80, srv248684446=59, srv1850937641=50, srv32609393=63, srv1418776450=24, srv1144639620=8, srv1934571877=54, srv1536102285=29, srv1841500497=49, srv1288601882=19, srv1868218365=52, srv116019036=9, srv49188137=77, srv45257472=75, srv1136239908=7, srv444487468=73, srv13693009=21, srv1544475910=30, srv384809107=67, srv193573761=55, srv1629380347=37, srv692829312=85, srv1239383484=13, srv808721480=93, srv417196448=70, srv321472723=61, srv47876865=76, srv548663251=82, srv1623608314=36, srv1362030058=20, srv321771918=62, srv1613351908=33, srv66532088=84, srv546854236=81, srv1774300138=46, srv1616597941=34, srv61027136=83, srv1370852641=22, srv177354498=45, srv1434866513=27, srv1641307551=38, srv1838323368=48, srv1434495727=26, srv385756803=68, srv1160903033=10, srv755449415=90, srv332464491=65, srv1673246548=41, srv981763205=99, srv1127046310=5, srv1750382817=44, srv450289883=74, srv1607306466=32, srv1271829642=16, srv803384932=92, srv1175312762=11, srv344226952=66, srv791817815=91, srv50493800=79, srv503708710=78, srv1131405217=6, srv1288064744=18, srv751767828=89, srv1642628948=39, srv425756880=71, srv1050424105=4, srv437047810=72, srv975444258=98, srv1786314031=47, srv96809168=97, srv871514710=94, srv1897633041=53, srv1268037597=15, srv711758867=87, srv1528720747=28, srv224644260=57, srv174019963=43, srv1041226655=2, srv128692585=17, srv2115661562=56, srv332150127=64, srv1182351455=12, srv940025376=95, srv1852118025=51} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:53:14,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:53:14,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 21:53:14,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 21:53:14,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 21:53:14,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 21:53:14,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 21:53:14,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 21:53:14,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 21:53:14,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 21:53:14,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 21:53:14,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 21:53:14,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 21:53:14,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 21:53:14,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 21:53:14,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 21:53:14,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 21:53:14,330 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7182857106794416E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:14,330 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1136239908:82 , srv1702377327:82 , srv1605077493:83 , srv1616597941:83 , srv1629380347:83 , srv1641307551:83 , srv1642628948:83 , srv1838323368:83 , srv193573761:83 , srv234610843:83 , srv321472723:83 , srv546854236:83 , srv66532088:83 , srv1015370426:84 , srv1041226655:84 , srv1127046310:84 , srv1131405217:84 , srv1144639620:84 , srv1160903033:84 , srv1175312762:84 , srv1239383484:84 , srv128692585:84 , srv1288064744:84 , srv1288601882:84 , srv13693009:84 , srv1370852641:84 , srv1395264928:84 , srv1528720747:84 , srv1536102285:84 , srv1544475910:84 , srv1607306466:84 , srv1613351908:84 , srv1618073031:84 , srv1673246548:84 , srv1841500497:84 , srv1897633041:84 , srv2115661562:84 , srv248684446:84 , srv321771918:84 , srv344226952:84 , srv384809107:84 , srv389985277:84 , srv417196448:84 , srv425756880:84 , srv47876865:84 , srv49188137:84 , srv503708710:84 , srv548663251:84 , srv61027136:84 , srv692829312:84 , srv711758867:84 , srv732934706:84 , srv751767828:84 , srv755449415:84 , srv791817815:84 , srv808721480:84 , srv940025376:84 , srv1037732481:85 , srv1041257924:85 , srv116019036:85 , srv1182351455:85 , srv1247549551:85 , srv1268037597:85 , srv1362030058:85 , srv1418776450:85 , srv1420811511:85 , srv1434495727:85 , srv1434866513:85 , srv1623608314:85 , srv1651126146:85 , srv174019963:85 , srv1750382817:85 , srv177354498:85 , srv1774300138:85 , srv1850937641:85 , srv1852118025:85 , srv1868218365:85 , srv1934571877:85 , srv28414855:85 , srv32609393:85 , srv332150127:85 , srv332464491:85 , srv385756803:85 , srv437047810:85 , srv444487468:85 , srv450289883:85 , srv45257472:85 , srv50493800:85 , srv708751145:85 , srv803384932:85 , srv871514710:85 , srv95034569:85 , srv96809168:85 , srv975444258:85 , srv981763205:85 , srv1050424105:86 , srv1271829642:86 , srv224644260:86 , srv516117031:86 , srv1786314031:653 }
2023-07-17 21:53:14,363 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 294), ProcessCount=173 (was 173), AvailableMemoryMB=7013 (was 7727)
2023-07-17 21:53:14,374 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=173, AvailableMemoryMB=7013
2023-07-17 21:53:14,375 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-17 21:53:14,375 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-17 21:53:14,388 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1190405188:84 , srv1194515041:84 , srv1200778001:84 , srv1214694779:84 , srv1331477243:84 , srv1348253915:84 , srv1402115992:84 , srv1461512509:84 , srv1518510663:84 , srv1567233890:84 , srv1639912773:84 , srv1731861612:84 , srv1748672452:84 , srv1852151310:84 , srv1886679961:84 , srv1892578505:84 , srv1896292790:84 , srv1903511953:84 , srv1959466023:84 , srv1995502189:84 , srv2032896649:84 , srv354704346:84 , srv358560681:84 , srv38177499:84 , srv681045928:84 , srv757551641:84 , srv820917174:84 , srv918498046:84 , srv923582469:84 , srv867926029:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-17 21:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:53:14,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1748672452=12, srv358560681=22, srv820917174=26, srv1331477243=4, srv1402115992=6, srv1194515041=1, srv38177499=23, srv1731861612=11, srv1892578505=15, srv354704346=21, srv1567233890=9, srv1190405188=0, srv681045928=24, srv1200778001=2, srv1959466023=18, srv1461512509=7, srv918498046=28, srv1348253915=5, srv1518510663=8, srv1214694779=3, srv1995502189=19, srv2032896649=20, srv1639912773=10, srv1896292790=16, srv867926029=27, srv1886679961=14, srv1903511953=17, srv923582469=29, srv1852151310=13, srv757551641=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:53:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:53:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:53:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:53:14,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-17 21:53:14,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1389378810242226, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:53:14,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912630831990646, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1389378810242226, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-17 21:55:14,412 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6325123 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912630831990646 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:55:14,420 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1190405188:90 , srv1194515041:90 , srv1200778001:90 , srv1214694779:90 , srv1331477243:90 , srv1348253915:90 , srv1402115992:90 , srv1461512509:90 , srv1518510663:90 , srv1567233890:90 , srv1639912773:90 , srv1731861612:90 , srv1748672452:90 , srv1852151310:90 , srv1886679961:90 , srv1892578505:90 , srv1896292790:90 , srv1903511953:90 , srv1959466023:90 , srv1995502189:90 , srv2032896649:90 , srv354704346:90 , srv358560681:90 , srv38177499:90 , srv681045928:90 , srv757551641:90 , srv820917174:90 , srv867926029:90 , srv918498046:90 , srv923582469:90 }
2023-07-17 21:55:14,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 21:55:14,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1748672452=12, srv358560681=22, srv820917174=26, srv1331477243=4, srv1402115992=6, srv1194515041=1, srv38177499=23, srv1731861612=11, srv1892578505=15, srv354704346=21, srv1567233890=9, srv1190405188=0, srv681045928=24, srv1200778001=2, srv1959466023=18, srv1461512509=7, srv918498046=28, srv1348253915=5, srv1518510663=8, srv1214694779=3, srv1995502189=19, srv2032896649=20, srv1639912773=10, srv1896292790=16, srv867926029=27, srv1886679961=14, srv1903511953=17, srv923582469=29, srv1852151310=13, srv757551641=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 21:55:14,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 21:55:14,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 21:55:14,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 21:55:14,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 21:55:14,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 21:55:14,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 21:55:14,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-17 21:55:14,443 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 21:55:14,443 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1190405188:90 , srv1194515041:90 , srv1200778001:90 , srv1214694779:90 , srv1331477243:90 , srv1348253915:90 , srv1402115992:90 , srv1461512509:90 , srv1518510663:90 , srv1567233890:90 , srv1639912773:90 , srv1731861612:90 , srv1748672452:90 , srv1852151310:90 , srv1886679961:90 , srv1892578505:90 , srv1896292790:90 , srv1903511953:90 , srv1959466023:90 , srv1995502189:90 , srv2032896649:90 , srv354704346:90 , srv358560681:90 , srv38177499:90 , srv681045928:90 , srv757551641:90 , srv820917174:90 , srv867926029:90 , srv918498046:90 , srv923582469:90 }
2023-07-17 21:55:14,458 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 294), ProcessCount=170 (was 173), AvailableMemoryMB=6291 (was 7013)