2023-12-21 21:53:18,744 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-21 21:53:19,064 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-21 21:53:19,183 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-21 21:53:19,253 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-21 21:53:19,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-21 21:53:19,277 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=3417
2023-12-21 21:53:19,280 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-21 21:53:19,281 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-21 21:53:19,402 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1038840549:84 , srv1084983422:84 , srv1085874165:84 , srv11146411:84 , srv1137085771:84 , srv1148855023:84 , srv1164793778:84 , srv1192285420:84 , srv1201939096:84 , srv1216737827:84 , srv1239885533:84 , srv1243137722:84 , srv1243324942:84 , srv1251134711:84 , srv1259350551:84 , srv1268754343:84 , srv1310403908:84 , srv1347787592:84 , srv1385568113:84 , srv1401208598:84 , srv1406685841:84 , srv1429624838:84 , srv1444443949:84 , srv1451888264:84 , srv1454410548:84 , srv1469517416:84 , srv1478300264:84 , srv1541208998:84 , srv1564201398:84 , srv1568160608:84 , srv1568799258:84 , srv1581348232:84 , srv1639697247:84 , srv1643365041:84 , srv1685340551:84 , srv1688797668:84 , srv175875257:84 , srv1765923305:84 , srv1772067808:84 , srv1775425436:84 , srv1791116016:84 , srv1825703094:84 , srv1854309788:84 , srv1855333845:84 , srv1868602102:84 , srv1926410888:84 , srv194418933:84 , srv1953969136:84 , srv1959515346:84 , srv1965311144:84 , srv1966928245:84 , srv1981027382:84 , srv1998964698:84 , srv2009348504:84 , srv2024832527:84 , srv2034730049:84 , srv2038007680:84 , srv2041055160:84 , srv2073292812:84 , srv2079768737:84 , srv2083507148:84 , srv2103280922:84 , srv2107603142:84 , srv2111299664:84 , srv215200498:84 , srv237947882:84 , srv254837292:84 , srv268921988:84 , srv271509723:84 , srv301242833:84 , srv301350661:84 , srv345484580:84 , srv389823154:84 , srv440737051:84 , srv474797013:84 , srv49504641:84 , srv517178118:84 , srv535606806:84 , srv542324948:84 , srv564124476:84 , srv565106782:84 , srv572221168:84 , srv581049653:84 , srv64489996:84 , srv667739876:84 , srv68299818:84 , srv691618671:84 , srv714574224:84 , srv78525784:84 , srv794646985:84 , srv799048399:84 , srv810256554:84 , srv814059771:84 , srv825438648:84 , srv894035801:84 , srv933060138:84 , srv945635382:84 , srv946445121:84 , srv958038666:84 , srv541539642:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-21 21:53:19,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1401208598=19, srv541539642=78, srv1259350551=14, srv945635382=97, srv581049653=83, srv215200498=64, srv1385568113=18, srv271509723=68, srv535606806=77, srv1953969136=47, srv1926410888=45, srv194418933=46, srv1685340551=34, srv1347787592=17, srv517178118=76, srv1243137722=11, srv1791116016=40, srv1192285420=7, srv2107603142=62, srv1268754343=15, srv564124476=80, srv1038840549=0, srv1639697247=32, srv814059771=93, srv1148855023=5, srv1216737827=9, srv2041055160=57, srv1643365041=33, srv714574224=88, srv1137085771=4, srv1444443949=22, srv1541208998=27, srv894035801=95, srv1478300264=26, srv78525784=89, srv1825703094=41, srv1164793778=6, srv2038007680=56, srv1201939096=8, srv2009348504=53, srv1568799258=30, srv1310403908=16, srv1469517416=25, srv1966928245=50, srv1243324942=12, srv1406685841=20, srv301350661=70, srv810256554=92, srv1564201398=28, srv301242833=69, srv2111299664=63, srv474797013=74, srv1965311144=49, srv1998964698=52, srv49504641=75, srv1688797668=35, srv794646985=90, srv667739876=85, srv1239885533=10, srv1429624838=21, srv2034730049=55, srv565106782=81, srv1855333845=43, srv254837292=66, srv11146411=3, srv1581348232=31, srv175875257=36, srv2073292812=58, srv1854309788=42, srv1765923305=37, srv1981027382=51, srv2024832527=54, srv440737051=73, srv1775425436=39, srv1454410548=24, srv933060138=96, srv946445121=98, srv268921988=67, srv958038666=99, srv389823154=72, srv64489996=84, srv1772067808=38, srv237947882=65, srv691618671=87, srv825438648=94, srv799048399=91, srv345484580=71, srv1451888264=23, srv1084983422=1, srv1085874165=2, srv68299818=86, srv2103280922=61, srv1959515346=48, srv2083507148=60, srv1568160608=29, srv572221168=82, srv2079768737=59, srv542324948=79, srv1251134711=13, srv1868602102=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:19,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:19,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:19,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:19,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:19,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:19,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:19,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:19,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:19,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:19,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:19,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:19,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:19,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:19,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:19,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:19,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:19,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:19,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 21:53:19,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 21:53:19,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 21:53:19,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 21:53:19,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 21:53:19,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 21:53:19,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 21:53:19,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 21:53:19,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 21:53:19,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:19,726 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 21:53:19,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 21:53:20,141 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 598 ms to try 5000 different iterations.  Found a solution that moves 4666 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18323064701646075. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03834979883528818, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.052128650318829954, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5184444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03834979883528818, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17833333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:20,157 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1192285420:82 , srv1038840549:83 , srv1310403908:83 , srv1643365041:83 , srv1981027382:83 , srv1084983422:84 , srv1164793778:84 , srv1216737827:84 , srv1347787592:84 , srv1401208598:84 , srv1469517416:84 , srv1568799258:84 , srv194418933:84 , srv1998964698:84 , srv2038007680:84 , srv2111299664:84 , srv301350661:84 , srv389823154:84 , srv691618671:84 , srv810256554:84 , srv1085874165:85 , srv1201939096:85 , srv1243137722:85 , srv1639697247:85 , srv175875257:85 , srv1772067808:85 , srv1791116016:85 , srv2107603142:85 , srv215200498:85 , srv535606806:85 , srv581049653:85 , srv794646985:85 , srv799048399:85 , srv11146411:86 , srv1148855023:86 , srv1239885533:86 , srv1385568113:86 , srv1406685841:86 , srv1454410548:86 , srv1541208998:86 , srv1581348232:86 , srv1926410888:86 , srv1966928245:86 , srv2041055160:86 , srv2103280922:86 , srv237947882:86 , srv271509723:86 , srv301242833:86 , srv345484580:86 , srv440737051:86 , srv517178118:86 , srv564124476:86 , srv958038666:86 , srv1268754343:87 , srv1429624838:87 , srv1451888264:87 , srv1688797668:87 , srv1765923305:87 , srv1825703094:87 , srv1855333845:87 , srv1965311144:87 , srv2034730049:87 , srv2079768737:87 , srv565106782:87 , srv64489996:87 , srv68299818:87 , srv814059771:87 , srv894035801:87 , srv1137085771:88 , srv1243324942:88 , srv1444443949:88 , srv1564201398:88 , srv1775425436:88 , srv1868602102:88 , srv1953969136:88 , srv2009348504:88 , srv254837292:88 , srv78525784:88 , srv933060138:88 , srv946445121:88 , srv1478300264:89 , srv1568160608:89 , srv1685340551:89 , srv1854309788:89 , srv1959515346:89 , srv2073292812:89 , srv2083507148:89 , srv542324948:89 , srv667739876:89 , srv945635382:89 , srv1251134711:90 , srv1259350551:90 , srv825438648:90 , srv2024832527:91 , srv268921988:91 , srv474797013:91 , srv572221168:91 , srv49504641:92 , srv714574224:93 , srv541539642:431 }
2023-12-21 21:53:20,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:20,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1401208598=19, srv541539642=78, srv1259350551=14, srv945635382=97, srv581049653=83, srv215200498=64, srv1385568113=18, srv271509723=68, srv535606806=77, srv1953969136=47, srv1926410888=45, srv194418933=46, srv1685340551=34, srv1347787592=17, srv517178118=76, srv1243137722=11, srv1791116016=40, srv1192285420=7, srv2107603142=62, srv1268754343=15, srv564124476=80, srv1038840549=0, srv1639697247=32, srv814059771=93, srv1148855023=5, srv1216737827=9, srv2041055160=57, srv1643365041=33, srv714574224=88, srv1137085771=4, srv1444443949=22, srv1541208998=27, srv894035801=95, srv1478300264=26, srv78525784=89, srv1825703094=41, srv1164793778=6, srv2038007680=56, srv1201939096=8, srv2009348504=53, srv1568799258=30, srv1310403908=16, srv1469517416=25, srv1966928245=50, srv1243324942=12, srv1406685841=20, srv301350661=70, srv810256554=92, srv1564201398=28, srv301242833=69, srv2111299664=63, srv474797013=74, srv1965311144=49, srv1998964698=52, srv49504641=75, srv1688797668=35, srv794646985=90, srv667739876=85, srv1239885533=10, srv1429624838=21, srv2034730049=55, srv565106782=81, srv1855333845=43, srv254837292=66, srv11146411=3, srv1581348232=31, srv175875257=36, srv2073292812=58, srv1854309788=42, srv1765923305=37, srv1981027382=51, srv2024832527=54, srv440737051=73, srv1775425436=39, srv1454410548=24, srv933060138=96, srv946445121=98, srv268921988=67, srv958038666=99, srv389823154=72, srv64489996=84, srv1772067808=38, srv237947882=65, srv691618671=87, srv825438648=94, srv799048399=91, srv345484580=71, srv1451888264=23, srv1084983422=1, srv1085874165=2, srv68299818=86, srv2103280922=61, srv1959515346=48, srv2083507148=60, srv1568160608=29, srv572221168=82, srv2079768737=59, srv542324948=79, srv1251134711=13, srv1868602102=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:20,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:20,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:20,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:20,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:20,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:20,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:20,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 21:53:20,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 21:53:20,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 21:53:20,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 21:53:20,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 21:53:20,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 21:53:20,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 21:53:20,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 21:53:20,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 21:53:20,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 21:53:20,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 21:53:20,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 21:53:20,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 21:53:20,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03834979883528818, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.052128650318829954, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03834979883528818, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17833333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:20,381 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 21:53:20,381 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18319797498614743, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03834979883528818, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.052128650318829954, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03834979883528818, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17833333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 21:53:20,699 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 462 ms to try 5000 different iterations.  Found a solution that moves 2673 regions; Going from a computed imbalance of 0.18319797498614743 to a new imbalance of 0.013776097216353965. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021049292205011585); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027067691675869456, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.297, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021049292205011585); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:20,708 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv49504641:79 , srv572221168:79 , srv714574224:80 , srv1251134711:82 , srv1564201398:82 , srv1688797668:82 , srv2024832527:82 , srv2083507148:82 , srv268921988:82 , srv474797013:82 , srv1259350551:83 , srv1775425436:83 , srv1825703094:83 , srv1854309788:83 , srv1953969136:83 , srv2073292812:83 , srv301242833:83 , srv825438648:83 , srv894035801:83 , srv11146411:84 , srv1406685841:84 , srv1429624838:84 , srv1568160608:84 , srv1581348232:84 , srv1685340551:84 , srv1765923305:84 , srv1868602102:84 , srv1965311144:84 , srv2034730049:84 , srv542324948:84 , srv667739876:84 , srv799048399:84 , srv1137085771:85 , srv1243324942:85 , srv1444443949:85 , srv2079768737:85 , srv2103280922:85 , srv237947882:85 , srv254837292:85 , srv271509723:85 , srv345484580:85 , srv564124476:85 , srv64489996:85 , srv68299818:85 , srv946445121:85 , srv1148855023:86 , srv1239885533:86 , srv1385568113:86 , srv1454410548:86 , srv1541208998:86 , srv1639697247:86 , srv1772067808:86 , srv1959515346:86 , srv1966928245:86 , srv2009348504:86 , srv215200498:86 , srv440737051:86 , srv933060138:86 , srv945635382:86 , srv1038840549:87 , srv1164793778:87 , srv1201939096:87 , srv1243137722:87 , srv1268754343:87 , srv1451888264:87 , srv1478300264:87 , srv1855333845:87 , srv1926410888:87 , srv194418933:87 , srv1981027382:87 , srv2041055160:87 , srv2107603142:87 , srv2111299664:87 , srv301350661:87 , srv565106782:87 , srv581049653:87 , srv691618671:87 , srv78525784:87 , srv794646985:87 , srv810256554:87 , srv958038666:87 , srv1084983422:88 , srv1085874165:88 , srv1216737827:88 , srv1310403908:88 , srv1469517416:88 , srv1568799258:88 , srv1643365041:88 , srv1791116016:88 , srv517178118:88 , srv814059771:88 , srv1347787592:89 , srv1401208598:89 , srv175875257:89 , srv1998964698:89 , srv2038007680:89 , srv389823154:90 , srv535606806:90 , srv1192285420:91 , srv541539642:530 }
2023-12-21 21:53:20,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:20,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1401208598=19, srv541539642=78, srv1259350551=14, srv945635382=97, srv581049653=83, srv215200498=64, srv1385568113=18, srv271509723=68, srv535606806=77, srv1953969136=47, srv1926410888=45, srv194418933=46, srv1685340551=34, srv1347787592=17, srv517178118=76, srv1243137722=11, srv1791116016=40, srv1192285420=7, srv2107603142=62, srv1268754343=15, srv564124476=80, srv1038840549=0, srv1639697247=32, srv814059771=93, srv1148855023=5, srv1216737827=9, srv2041055160=57, srv1643365041=33, srv714574224=88, srv1137085771=4, srv1444443949=22, srv1541208998=27, srv894035801=95, srv1478300264=26, srv78525784=89, srv1825703094=41, srv1164793778=6, srv2038007680=56, srv1201939096=8, srv2009348504=53, srv1568799258=30, srv1310403908=16, srv1469517416=25, srv1966928245=50, srv1243324942=12, srv1406685841=20, srv301350661=70, srv810256554=92, srv1564201398=28, srv301242833=69, srv2111299664=63, srv474797013=74, srv1965311144=49, srv1998964698=52, srv49504641=75, srv1688797668=35, srv794646985=90, srv667739876=85, srv1239885533=10, srv1429624838=21, srv2034730049=55, srv565106782=81, srv1855333845=43, srv254837292=66, srv11146411=3, srv1581348232=31, srv175875257=36, srv2073292812=58, srv1854309788=42, srv1765923305=37, srv1981027382=51, srv2024832527=54, srv440737051=73, srv1775425436=39, srv1454410548=24, srv933060138=96, srv946445121=98, srv268921988=67, srv958038666=99, srv389823154=72, srv64489996=84, srv1772067808=38, srv237947882=65, srv691618671=87, srv825438648=94, srv799048399=91, srv345484580=71, srv1451888264=23, srv1084983422=1, srv1085874165=2, srv68299818=86, srv2103280922=61, srv1959515346=48, srv2083507148=60, srv1568160608=29, srv572221168=82, srv2079768737=59, srv542324948=79, srv1251134711=13, srv1868602102=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 21:53:20,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021049292205011585); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027067691675869456, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021049292205011585); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:20,863 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 21:53:20,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01375738047031293, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021049292205011585); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027067691675869456, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021049292205011585); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 21:53:21,127 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 373 ms to try 5000 different iterations.  Found a solution that moves 962 regions; Going from a computed imbalance of 0.01375738047031293 to a new imbalance of 8.895747842995005E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007466097461068055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813742790348397); MoveCostFunction : (multiplier=7.0, imbalance=0.1068888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007466097461068055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:21,130 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1478300264:81 , srv945635382:81 , srv1268754343:82 , srv1959515346:82 , srv78525784:82 , srv1192285420:83 , srv1243324942:83 , srv175875257:83 , srv1855333845:83 , srv2009348504:83 , srv535606806:83 , srv814059771:83 , srv1085874165:84 , srv1137085771:84 , srv1243137722:84 , srv1259350551:84 , srv1401208598:84 , srv1444443949:84 , srv1451888264:84 , srv1568160608:84 , srv1685340551:84 , srv1854309788:84 , srv1966928245:84 , srv2024832527:84 , srv2038007680:84 , srv2107603142:84 , srv254837292:84 , srv389823154:84 , srv517178118:84 , srv667739876:84 , srv714574224:84 , srv825438648:84 , srv933060138:84 , srv958038666:84 , srv1084983422:85 , srv1148855023:85 , srv1216737827:85 , srv1347787592:85 , srv1385568113:85 , srv1541208998:85 , srv1568799258:85 , srv1639697247:85 , srv1791116016:85 , srv1926410888:85 , srv1953969136:85 , srv1998964698:85 , srv2041055160:85 , srv237947882:85 , srv268921988:85 , srv440737051:85 , srv542324948:85 , srv565106782:85 , srv794646985:85 , srv11146411:86 , srv1164793778:86 , srv1201939096:86 , srv1239885533:86 , srv1251134711:86 , srv1310403908:86 , srv1469517416:86 , srv1564201398:86 , srv1765923305:86 , srv1775425436:86 , srv1868602102:86 , srv194418933:86 , srv2034730049:86 , srv2079768737:86 , srv2103280922:86 , srv2111299664:86 , srv215200498:86 , srv301350661:86 , srv345484580:86 , srv474797013:86 , srv49504641:86 , srv564124476:86 , srv581049653:86 , srv68299818:86 , srv691618671:86 , srv810256554:86 , srv946445121:86 , srv1454410548:87 , srv1581348232:87 , srv1643365041:87 , srv1772067808:87 , srv1825703094:87 , srv1965311144:87 , srv1981027382:87 , srv2073292812:87 , srv2083507148:87 , srv271509723:87 , srv572221168:87 , srv64489996:87 , srv894035801:87 , srv1688797668:88 , srv301242833:88 , srv1038840549:89 , srv1406685841:89 , srv1429624838:89 , srv799048399:89 , srv541539642:563 }
2023-12-21 21:53:21,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:21,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1401208598=19, srv541539642=78, srv1259350551=14, srv945635382=97, srv581049653=83, srv215200498=64, srv1385568113=18, srv271509723=68, srv535606806=77, srv1953969136=47, srv1926410888=45, srv194418933=46, srv1685340551=34, srv1347787592=17, srv517178118=76, srv1243137722=11, srv1791116016=40, srv1192285420=7, srv2107603142=62, srv1268754343=15, srv564124476=80, srv1038840549=0, srv1639697247=32, srv814059771=93, srv1148855023=5, srv1216737827=9, srv2041055160=57, srv1643365041=33, srv714574224=88, srv1137085771=4, srv1444443949=22, srv1541208998=27, srv894035801=95, srv1478300264=26, srv78525784=89, srv1825703094=41, srv1164793778=6, srv2038007680=56, srv1201939096=8, srv2009348504=53, srv1568799258=30, srv1310403908=16, srv1469517416=25, srv1966928245=50, srv1243324942=12, srv1406685841=20, srv301350661=70, srv810256554=92, srv1564201398=28, srv301242833=69, srv2111299664=63, srv474797013=74, srv1965311144=49, srv1998964698=52, srv49504641=75, srv1688797668=35, srv794646985=90, srv667739876=85, srv1239885533=10, srv1429624838=21, srv2034730049=55, srv565106782=81, srv1855333845=43, srv254837292=66, srv11146411=3, srv1581348232=31, srv175875257=36, srv2073292812=58, srv1854309788=42, srv1765923305=37, srv1981027382=51, srv2024832527=54, srv440737051=73, srv1775425436=39, srv1454410548=24, srv933060138=96, srv946445121=98, srv268921988=67, srv958038666=99, srv389823154=72, srv64489996=84, srv1772067808=38, srv237947882=65, srv691618671=87, srv825438648=94, srv799048399=91, srv345484580=71, srv1451888264=23, srv1084983422=1, srv1085874165=2, srv68299818=86, srv2103280922=61, srv1959515346=48, srv2083507148=60, srv1568160608=29, srv572221168=82, srv2079768737=59, srv542324948=79, srv1251134711=13, srv1868602102=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:21,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:21,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 21:53:21,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 21:53:21,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 21:53:21,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 21:53:21,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 21:53:21,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 21:53:21,268 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007466097461068055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813742790348397); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007466097461068055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:21,268 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 21:53:21,268 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.828387163266329E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007466097461068055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813742790348397); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007466097461068055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 21:53:21,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 470 ms to try 5000 different iterations.  Found a solution that moves 272 regions; Going from a computed imbalance of 8.828387163266329E-4 to a new imbalance of 3.6197068042589716E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.030222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:21,637 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1038840549:83 , srv1406685841:83 , srv1429624838:83 , srv1454410548:83 , srv2073292812:83 , srv474797013:83 , srv565106782:83 , srv64489996:83 , srv946445121:83 , srv1164793778:84 , srv1201939096:84 , srv1239885533:84 , srv1251134711:84 , srv1347787592:84 , srv1444443949:84 , srv1451888264:84 , srv1469517416:84 , srv1568799258:84 , srv1643365041:84 , srv1772067808:84 , srv1868602102:84 , srv1926410888:84 , srv194418933:84 , srv1965311144:84 , srv1998964698:84 , srv2009348504:84 , srv2034730049:84 , srv2041055160:84 , srv2079768737:84 , srv2083507148:84 , srv268921988:84 , srv271509723:84 , srv389823154:84 , srv517178118:84 , srv535606806:84 , srv542324948:84 , srv581049653:84 , srv68299818:84 , srv799048399:84 , srv814059771:84 , srv1084983422:85 , srv1085874165:85 , srv1137085771:85 , srv1148855023:85 , srv1216737827:85 , srv1259350551:85 , srv1268754343:85 , srv1310403908:85 , srv1385568113:85 , srv1401208598:85 , srv1478300264:85 , srv1541208998:85 , srv1568160608:85 , srv1581348232:85 , srv1685340551:85 , srv1688797668:85 , srv175875257:85 , srv1775425436:85 , srv1791116016:85 , srv1825703094:85 , srv1855333845:85 , srv1959515346:85 , srv1981027382:85 , srv2024832527:85 , srv2038007680:85 , srv2103280922:85 , srv2111299664:85 , srv215200498:85 , srv254837292:85 , srv301242833:85 , srv301350661:85 , srv345484580:85 , srv440737051:85 , srv49504641:85 , srv564124476:85 , srv572221168:85 , srv667739876:85 , srv78525784:85 , srv794646985:85 , srv810256554:85 , srv825438648:85 , srv894035801:85 , srv933060138:85 , srv958038666:85 , srv11146411:86 , srv1192285420:86 , srv1243324942:86 , srv1564201398:86 , srv1639697247:86 , srv1765923305:86 , srv1854309788:86 , srv1953969136:86 , srv1966928245:86 , srv2107603142:86 , srv237947882:86 , srv691618671:86 , srv714574224:86 , srv945635382:86 , srv1243137722:87 , srv541539642:618 }
2023-12-21 21:53:21,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:21,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1401208598=19, srv541539642=78, srv1259350551=14, srv945635382=97, srv581049653=83, srv215200498=64, srv1385568113=18, srv271509723=68, srv535606806=77, srv1953969136=47, srv1926410888=45, srv194418933=46, srv1685340551=34, srv1347787592=17, srv517178118=76, srv1243137722=11, srv1791116016=40, srv1192285420=7, srv2107603142=62, srv1268754343=15, srv564124476=80, srv1038840549=0, srv1639697247=32, srv814059771=93, srv1148855023=5, srv1216737827=9, srv2041055160=57, srv1643365041=33, srv714574224=88, srv1137085771=4, srv1444443949=22, srv1541208998=27, srv894035801=95, srv1478300264=26, srv78525784=89, srv1825703094=41, srv1164793778=6, srv2038007680=56, srv1201939096=8, srv2009348504=53, srv1568799258=30, srv1310403908=16, srv1469517416=25, srv1966928245=50, srv1243324942=12, srv1406685841=20, srv301350661=70, srv810256554=92, srv1564201398=28, srv301242833=69, srv2111299664=63, srv474797013=74, srv1965311144=49, srv1998964698=52, srv49504641=75, srv1688797668=35, srv794646985=90, srv667739876=85, srv1239885533=10, srv1429624838=21, srv2034730049=55, srv565106782=81, srv1855333845=43, srv254837292=66, srv11146411=3, srv1581348232=31, srv175875257=36, srv2073292812=58, srv1854309788=42, srv1765923305=37, srv1981027382=51, srv2024832527=54, srv440737051=73, srv1775425436=39, srv1454410548=24, srv933060138=96, srv946445121=98, srv268921988=67, srv958038666=99, srv389823154=72, srv64489996=84, srv1772067808=38, srv237947882=65, srv691618671=87, srv825438648=94, srv799048399=91, srv345484580=71, srv1451888264=23, srv1084983422=1, srv1085874165=2, srv68299818=86, srv2103280922=61, srv1959515346=48, srv2083507148=60, srv1568160608=29, srv572221168=82, srv2079768737=59, srv542324948=79, srv1251134711=13, srv1868602102=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:21,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:21,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 21:53:21,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 21:53:21,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 21:53:21,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 21:53:21,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 21:53:21,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 21:53:21,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 21:53:21,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 21:53:21,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 21:53:21,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 21:53:21,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 21:53:21,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 21:53:21,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 21:53:21,772 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:21,772 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 21:53:21,772 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.429248333508452E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 21:53:22,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 350 ms to try 5000 different iterations.  Found a solution that moves 33 regions; Going from a computed imbalance of 3.429248333508452E-5 to a new imbalance of 7.618828439090763E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0036666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:22,024 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1243137722:83 , srv1429624838:83 , srv1765923305:83 , srv1791116016:83 , srv691618671:83 , srv714574224:83 , srv933060138:83 , srv1038840549:84 , srv1084983422:84 , srv1085874165:84 , srv11146411:84 , srv1137085771:84 , srv1148855023:84 , srv1192285420:84 , srv1201939096:84 , srv1216737827:84 , srv1239885533:84 , srv1243324942:84 , srv1251134711:84 , srv1259350551:84 , srv1310403908:84 , srv1347787592:84 , srv1385568113:84 , srv1401208598:84 , srv1406685841:84 , srv1451888264:84 , srv1454410548:84 , srv1469517416:84 , srv1478300264:84 , srv1541208998:84 , srv1564201398:84 , srv1568160608:84 , srv1581348232:84 , srv1639697247:84 , srv1643365041:84 , srv1685340551:84 , srv1688797668:84 , srv175875257:84 , srv1772067808:84 , srv1775425436:84 , srv1825703094:84 , srv1854309788:84 , srv1855333845:84 , srv1868602102:84 , srv1926410888:84 , srv1953969136:84 , srv1959515346:84 , srv1965311144:84 , srv1966928245:84 , srv1981027382:84 , srv1998964698:84 , srv2024832527:84 , srv2038007680:84 , srv2041055160:84 , srv2073292812:84 , srv2079768737:84 , srv2083507148:84 , srv2103280922:84 , srv2107603142:84 , srv2111299664:84 , srv215200498:84 , srv237947882:84 , srv254837292:84 , srv268921988:84 , srv271509723:84 , srv301242833:84 , srv301350661:84 , srv345484580:84 , srv389823154:84 , srv440737051:84 , srv474797013:84 , srv49504641:84 , srv517178118:84 , srv535606806:84 , srv542324948:84 , srv564124476:84 , srv565106782:84 , srv572221168:84 , srv581049653:84 , srv64489996:84 , srv667739876:84 , srv68299818:84 , srv78525784:84 , srv794646985:84 , srv799048399:84 , srv810256554:84 , srv814059771:84 , srv825438648:84 , srv894035801:84 , srv945635382:84 , srv946445121:84 , srv958038666:84 , srv1164793778:85 , srv1268754343:85 , srv1444443949:85 , srv1568799258:85 , srv194418933:85 , srv2009348504:85 , srv2034730049:85 , srv541539642:684 }
2023-12-21 21:53:22,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:22,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1401208598=19, srv541539642=78, srv1259350551=14, srv945635382=97, srv581049653=83, srv215200498=64, srv1385568113=18, srv271509723=68, srv535606806=77, srv1953969136=47, srv1926410888=45, srv194418933=46, srv1685340551=34, srv1347787592=17, srv517178118=76, srv1243137722=11, srv1791116016=40, srv1192285420=7, srv2107603142=62, srv1268754343=15, srv564124476=80, srv1038840549=0, srv1639697247=32, srv814059771=93, srv1148855023=5, srv1216737827=9, srv2041055160=57, srv1643365041=33, srv714574224=88, srv1137085771=4, srv1444443949=22, srv1541208998=27, srv894035801=95, srv1478300264=26, srv78525784=89, srv1825703094=41, srv1164793778=6, srv2038007680=56, srv1201939096=8, srv2009348504=53, srv1568799258=30, srv1310403908=16, srv1469517416=25, srv1966928245=50, srv1243324942=12, srv1406685841=20, srv301350661=70, srv810256554=92, srv1564201398=28, srv301242833=69, srv2111299664=63, srv474797013=74, srv1965311144=49, srv1998964698=52, srv49504641=75, srv1688797668=35, srv794646985=90, srv667739876=85, srv1239885533=10, srv1429624838=21, srv2034730049=55, srv565106782=81, srv1855333845=43, srv254837292=66, srv11146411=3, srv1581348232=31, srv175875257=36, srv2073292812=58, srv1854309788=42, srv1765923305=37, srv1981027382=51, srv2024832527=54, srv440737051=73, srv1775425436=39, srv1454410548=24, srv933060138=96, srv946445121=98, srv268921988=67, srv958038666=99, srv389823154=72, srv64489996=84, srv1772067808=38, srv237947882=65, srv691618671=87, srv825438648=94, srv799048399=91, srv345484580=71, srv1451888264=23, srv1084983422=1, srv1085874165=2, srv68299818=86, srv2103280922=61, srv1959515346=48, srv2083507148=60, srv1568160608=29, srv572221168=82, srv2079768737=59, srv542324948=79, srv1251134711=13, srv1868602102=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:22,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:22,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:22,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:22,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:22,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:22,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 21:53:22,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 21:53:22,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 21:53:22,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 21:53:22,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 21:53:22,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:22,153 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1243137722:83 , srv1429624838:83 , srv1765923305:83 , srv1791116016:83 , srv691618671:83 , srv714574224:83 , srv933060138:83 , srv1038840549:84 , srv1084983422:84 , srv1085874165:84 , srv11146411:84 , srv1137085771:84 , srv1148855023:84 , srv1192285420:84 , srv1201939096:84 , srv1216737827:84 , srv1239885533:84 , srv1243324942:84 , srv1251134711:84 , srv1259350551:84 , srv1310403908:84 , srv1347787592:84 , srv1385568113:84 , srv1401208598:84 , srv1406685841:84 , srv1451888264:84 , srv1454410548:84 , srv1469517416:84 , srv1478300264:84 , srv1541208998:84 , srv1564201398:84 , srv1568160608:84 , srv1581348232:84 , srv1639697247:84 , srv1643365041:84 , srv1685340551:84 , srv1688797668:84 , srv175875257:84 , srv1772067808:84 , srv1775425436:84 , srv1825703094:84 , srv1854309788:84 , srv1855333845:84 , srv1868602102:84 , srv1926410888:84 , srv1953969136:84 , srv1959515346:84 , srv1965311144:84 , srv1966928245:84 , srv1981027382:84 , srv1998964698:84 , srv2024832527:84 , srv2038007680:84 , srv2041055160:84 , srv2073292812:84 , srv2079768737:84 , srv2083507148:84 , srv2103280922:84 , srv2107603142:84 , srv2111299664:84 , srv215200498:84 , srv237947882:84 , srv254837292:84 , srv268921988:84 , srv271509723:84 , srv301242833:84 , srv301350661:84 , srv345484580:84 , srv389823154:84 , srv440737051:84 , srv474797013:84 , srv49504641:84 , srv517178118:84 , srv535606806:84 , srv542324948:84 , srv564124476:84 , srv565106782:84 , srv572221168:84 , srv581049653:84 , srv64489996:84 , srv667739876:84 , srv68299818:84 , srv78525784:84 , srv794646985:84 , srv799048399:84 , srv810256554:84 , srv814059771:84 , srv825438648:84 , srv894035801:84 , srv945635382:84 , srv946445121:84 , srv958038666:84 , srv1164793778:85 , srv1268754343:85 , srv1444443949:85 , srv1568799258:85 , srv194418933:85 , srv2009348504:85 , srv2034730049:85 , srv541539642:684 }
2023-12-21 21:53:22,178 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 291), ProcessCount=170 (was 170), AvailableMemoryMB=2812 (was 3417)
2023-12-21 21:53:22,185 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=2812
2023-12-21 21:53:22,186 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-21 21:53:22,186 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-21 21:53:22,197 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008297197:84 , srv1069799213:84 , srv1329349012:84 , srv1495985967:84 , srv1501769504:84 , srv1535108691:84 , srv1552386623:84 , srv1796592202:84 , srv1801414944:84 , srv1885905673:84 , srv1897043208:84 , srv1945068139:84 , srv2001006904:84 , srv2025068972:84 , srv2067876930:84 , srv2109873235:84 , srv272663464:84 , srv328996772:84 , srv334162566:84 , srv348850355:84 , srv388338297:84 , srv404702527:84 , srv487987228:84 , srv499173294:84 , srv69239271:84 , srv873488500:84 , srv905961789:84 , srv910359679:84 , srv91442370:84 , srv248430249:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-21 21:53:22,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:53:22,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2001006904=12, srv2109873235=15, srv1501769504=4, srv91442370=29, srv334162566=19, srv348850355=20, srv487987228=23, srv1535108691=5, srv69239271=25, srv1945068139=11, srv499173294=24, srv1069799213=1, srv1801414944=8, srv905961789=27, srv873488500=26, srv2067876930=14, srv1796592202=7, srv328996772=18, srv1495985967=3, srv910359679=28, srv2025068972=13, srv1329349012=2, srv1008297197=0, srv1897043208=10, srv1552386623=6, srv1885905673=9, srv404702527=22, srv388338297=21, srv248430249=16, srv272663464=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:53:22,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:53:22,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:53:22,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:53:22,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:53:22,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:53:22,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:53:22,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:53:22,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:53:22,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:53:22,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:53:22,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-21 21:53:22,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1593780082567908, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:53:22,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912695238164125, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1593780082567908, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-21 21:55:22,216 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5431725 different iterations.  Found a solution that moves 1865 regions; Going from a computed imbalance of 0.9912695238164125 to a new imbalance of 4.353003038599517E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6907407407407408, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:55:22,223 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1008297197:90 , srv1069799213:90 , srv1329349012:90 , srv1495985967:90 , srv1501769504:90 , srv1535108691:90 , srv1552386623:90 , srv1796592202:90 , srv1801414944:90 , srv1885905673:90 , srv1897043208:90 , srv1945068139:90 , srv2001006904:90 , srv2025068972:90 , srv2067876930:90 , srv2109873235:90 , srv248430249:90 , srv272663464:90 , srv328996772:90 , srv334162566:90 , srv348850355:90 , srv388338297:90 , srv404702527:90 , srv487987228:90 , srv499173294:90 , srv69239271:90 , srv873488500:90 , srv905961789:90 , srv910359679:90 , srv91442370:90 }
2023-12-21 21:55:22,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 21:55:22,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2001006904=12, srv2109873235=15, srv1501769504=4, srv91442370=29, srv334162566=19, srv348850355=20, srv487987228=23, srv1535108691=5, srv69239271=25, srv1945068139=11, srv499173294=24, srv1069799213=1, srv1801414944=8, srv905961789=27, srv873488500=26, srv2067876930=14, srv1796592202=7, srv328996772=18, srv1495985967=3, srv910359679=28, srv2025068972=13, srv1329349012=2, srv1008297197=0, srv1897043208=10, srv1552386623=6, srv1885905673=9, srv404702527=22, srv388338297=21, srv248430249=16, srv272663464=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 21:55:22,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 21:55:22,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 21:55:22,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 21:55:22,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 21:55:22,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 21:55:22,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 21:55:22,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 21:55:22,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 21:55:22,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-21 21:55:22,241 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 21:55:22,242 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1008297197:90 , srv1069799213:90 , srv1329349012:90 , srv1495985967:90 , srv1501769504:90 , srv1535108691:90 , srv1552386623:90 , srv1796592202:90 , srv1801414944:90 , srv1885905673:90 , srv1897043208:90 , srv1945068139:90 , srv2001006904:90 , srv2025068972:90 , srv2067876930:90 , srv2109873235:90 , srv248430249:90 , srv272663464:90 , srv328996772:90 , srv334162566:90 , srv348850355:90 , srv388338297:90 , srv404702527:90 , srv487987228:90 , srv499173294:90 , srv69239271:90 , srv873488500:90 , srv905961789:90 , srv910359679:90 , srv91442370:90 }
2023-12-21 21:55:22,254 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 291), ProcessCount=170 (was 170), AvailableMemoryMB=1916 (was 2812)