2023-09-17 20:54:17,821 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-17 20:54:18,056 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-17 20:54:18,153 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-17 20:54:18,211 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-17 20:54:18,217 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-17 20:54:18,227 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=167, AvailableMemoryMB=3485
2023-09-17 20:54:18,229 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-17 20:54:18,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-17 20:54:18,350 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012098097:84 , srv1020531809:84 , srv1025181941:84 , srv1025577262:84 , srv1045165607:84 , srv1051717488:84 , srv1053638867:84 , srv1059497716:84 , srv1116178609:84 , srv115820099:84 , srv117370768:84 , srv1200839115:84 , srv1246977557:84 , srv124917067:84 , srv1250947973:84 , srv126080390:84 , srv1336526046:84 , srv1375455676:84 , srv1386536315:84 , srv1393571507:84 , srv1411797094:84 , srv1420937103:84 , srv1480354712:84 , srv1488415132:84 , srv1507142341:84 , srv1520628473:84 , srv1582400887:84 , srv1601155074:84 , srv1610303819:84 , srv1612772733:84 , srv1618708538:84 , srv1619906295:84 , srv1645704832:84 , srv1661511847:84 , srv1674394600:84 , srv1676227101:84 , srv1696449789:84 , srv1729948081:84 , srv1739423765:84 , srv1744536123:84 , srv1757310805:84 , srv1777459355:84 , srv1781465965:84 , srv1783478905:84 , srv1785716412:84 , srv1796451030:84 , srv1877483832:84 , srv190295969:84 , srv1921141244:84 , srv1924039244:84 , srv1976163052:84 , srv2010123297:84 , srv2042713814:84 , srv2046320679:84 , srv204999414:84 , srv2065717756:84 , srv2108487921:84 , srv2113352981:84 , srv2121139121:84 , srv2136684406:84 , srv218173195:84 , srv241917338:84 , srv252269020:84 , srv326108775:84 , srv340780093:84 , srv355180933:84 , srv378372387:84 , srv402363943:84 , srv408151396:84 , srv427562319:84 , srv434436391:84 , srv447299406:84 , srv462606905:84 , srv475285707:84 , srv483158683:84 , srv497411825:84 , srv537758087:84 , srv586510797:84 , srv608736089:84 , srv611246887:84 , srv632478565:84 , srv654950965:84 , srv659267486:84 , srv665248313:84 , srv672944364:84 , srv688057869:84 , srv702081320:84 , srv709669169:84 , srv712050951:84 , srv744782491:84 , srv761723623:84 , srv76339977:84 , srv793674325:84 , srv799092814:84 , srv801703529:84 , srv822547036:84 , srv848984681:84 , srv990699560:84 , srv995169008:84 , srv273761656:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-17 20:54:18,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:18,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046320679=53, srv252269020=62, srv799092814=94, srv2065717756=55, srv1025181941=2, srv1976163052=50, srv1582400887=26, srv326108775=64, srv475285707=74, srv1059497716=7, srv340780093=65, srv632478565=81, srv1375455676=17, srv1420937103=21, srv1921141244=48, srv124917067=13, srv1012098097=0, srv1386536315=18, srv586510797=78, srv76339977=92, srv218173195=60, srv2113352981=57, srv1488415132=23, srv1739423765=38, srv848984681=97, srv1781465965=42, srv712050951=89, srv1744536123=39, srv402363943=68, srv1618708538=30, srv483158683=75, srv672944364=85, srv1480354712=22, srv462606905=73, srv665248313=84, srv1250947973=14, srv117370768=10, srv744782491=90, srv1393571507=19, srv1785716412=44, srv1676227101=35, srv190295969=47, srv1520628473=25, srv1729948081=37, srv1877483832=46, srv688057869=86, srv2136684406=59, srv1045165607=4, srv608736089=79, srv995169008=99, srv2042713814=52, srv990699560=98, srv793674325=93, srv1645704832=32, srv2121139121=58, srv1411797094=20, srv241917338=61, srv537758087=77, srv1610303819=28, srv408151396=69, srv659267486=83, srv115820099=9, srv1116178609=8, srv1336526046=16, srv1507142341=24, srv1696449789=36, srv447299406=72, srv1053638867=6, srv611246887=80, srv1200839115=11, srv378372387=67, srv1674394600=34, srv761723623=91, srv822547036=96, srv1025577262=3, srv1601155074=27, srv801703529=95, srv427562319=70, srv654950965=82, srv355180933=66, srv1783478905=43, srv1924039244=49, srv1777459355=41, srv1619906295=31, srv273761656=63, srv1796451030=45, srv1020531809=1, srv1757310805=40, srv709669169=88, srv204999414=54, srv497411825=76, srv1612772733=29, srv2108487921=56, srv1051717488=5, srv1661511847=33, srv126080390=15, srv1246977557=12, srv2010123297=51, srv434436391=71, srv702081320=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:18,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:18,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:18,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-17 20:54:18,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-17 20:54:18,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-17 20:54:18,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-17 20:54:18,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-17 20:54:18,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-17 20:54:18,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-17 20:54:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-17 20:54:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-17 20:54:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-17 20:54:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-17 20:54:18,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-17 20:54:18,611 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:18,612 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-17 20:54:18,612 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-17 20:54:18,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 384 ms to try 5000 different iterations.  Found a solution that moves 4688 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17743253175221346. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04074349546854547, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05979200761877941, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5208888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04074349546854547, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17283333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:18,869 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1618708538:81 , srv672944364:81 , srv1488415132:82 , srv408151396:82 , srv654950965:82 , srv126080390:83 , srv1480354712:83 , srv1921141244:83 , srv2121139121:83 , srv475285707:83 , srv497411825:83 , srv632478565:83 , srv995169008:83 , srv1393571507:84 , srv1645704832:84 , srv1674394600:84 , srv2113352981:84 , srv252269020:84 , srv483158683:84 , srv688057869:84 , srv712050951:84 , srv793674325:84 , srv1059497716:85 , srv1246977557:85 , srv1375455676:85 , srv1386536315:85 , srv1420937103:85 , srv1610303819:85 , srv1729948081:85 , srv1739423765:85 , srv1796451030:85 , srv1877483832:85 , srv204999414:85 , srv218173195:85 , srv241917338:85 , srv355180933:85 , srv402363943:85 , srv427562319:85 , srv434436391:85 , srv611246887:85 , srv709669169:85 , srv744782491:85 , srv1116178609:86 , srv1676227101:86 , srv1781465965:86 , srv1924039244:86 , srv1976163052:86 , srv2046320679:86 , srv2065717756:86 , srv326108775:86 , srv462606905:86 , srv665248313:86 , srv848984681:86 , srv1012098097:87 , srv1051717488:87 , srv1250947973:87 , srv1411797094:87 , srv1507142341:87 , srv1582400887:87 , srv1696449789:87 , srv1744536123:87 , srv1757310805:87 , srv1777459355:87 , srv340780093:87 , srv378372387:87 , srv537758087:87 , srv608736089:87 , srv702081320:87 , srv761723623:87 , srv799092814:87 , srv801703529:87 , srv990699560:87 , srv1020531809:88 , srv1025181941:88 , srv115820099:88 , srv1200839115:88 , srv124917067:88 , srv1336526046:88 , srv1520628473:88 , srv1601155074:88 , srv1619906295:88 , srv190295969:88 , srv2010123297:88 , srv2042713814:88 , srv2108487921:88 , srv1025577262:89 , srv1045165607:89 , srv1612772733:89 , srv2136684406:89 , srv76339977:89 , srv1661511847:90 , srv1783478905:90 , srv447299406:90 , srv586510797:90 , srv117370768:93 , srv822547036:94 , srv1053638867:95 , srv1785716412:95 , srv659267486:95 , srv273761656:452 }
2023-09-17 20:54:18,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:18,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046320679=53, srv252269020=62, srv799092814=94, srv2065717756=55, srv1025181941=2, srv1976163052=50, srv1582400887=26, srv326108775=64, srv475285707=74, srv1059497716=7, srv340780093=65, srv632478565=81, srv1375455676=17, srv1420937103=21, srv1921141244=48, srv124917067=13, srv1012098097=0, srv1386536315=18, srv586510797=78, srv76339977=92, srv218173195=60, srv2113352981=57, srv1488415132=23, srv1739423765=38, srv848984681=97, srv1781465965=42, srv712050951=89, srv1744536123=39, srv402363943=68, srv1618708538=30, srv483158683=75, srv672944364=85, srv1480354712=22, srv462606905=73, srv665248313=84, srv1250947973=14, srv117370768=10, srv744782491=90, srv1393571507=19, srv1785716412=44, srv1676227101=35, srv190295969=47, srv1520628473=25, srv1729948081=37, srv1877483832=46, srv688057869=86, srv2136684406=59, srv1045165607=4, srv608736089=79, srv995169008=99, srv2042713814=52, srv990699560=98, srv793674325=93, srv1645704832=32, srv2121139121=58, srv1411797094=20, srv241917338=61, srv537758087=77, srv1610303819=28, srv408151396=69, srv659267486=83, srv115820099=9, srv1116178609=8, srv1336526046=16, srv1507142341=24, srv1696449789=36, srv447299406=72, srv1053638867=6, srv611246887=80, srv1200839115=11, srv378372387=67, srv1674394600=34, srv761723623=91, srv822547036=96, srv1025577262=3, srv1601155074=27, srv801703529=95, srv427562319=70, srv654950965=82, srv355180933=66, srv1783478905=43, srv1924039244=49, srv1777459355=41, srv1619906295=31, srv273761656=63, srv1796451030=45, srv1020531809=1, srv1757310805=40, srv709669169=88, srv204999414=54, srv497411825=76, srv1612772733=29, srv2108487921=56, srv1051717488=5, srv1661511847=33, srv126080390=15, srv1246977557=12, srv2010123297=51, srv434436391=71, srv702081320=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:18,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:18,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:18,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:18,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-17 20:54:18,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-17 20:54:18,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-17 20:54:18,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-17 20:54:18,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-17 20:54:18,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-17 20:54:18,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-17 20:54:18,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04074349546854547, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05979200761877941, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04074349546854547, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17283333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:18,984 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-17 20:54:18,985 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17739970567460764, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04074349546854547, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05979200761877941, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04074349546854547, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17283333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-17 20:54:19,167 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 259 ms to try 5000 different iterations.  Found a solution that moves 2636 regions; Going from a computed imbalance of 0.17739970567460764 to a new imbalance of 0.014960483026809511. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02418802351075378); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035216183403556194, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29288888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02418802351075378); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04708333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:19,175 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv659267486:77 , srv1053638867:79 , srv1785716412:79 , srv117370768:81 , srv1025181941:82 , srv1200839115:82 , srv1619906295:82 , srv1661511847:82 , srv1783478905:82 , srv2136684406:82 , srv537758087:82 , srv822547036:82 , srv1025577262:83 , srv115820099:83 , srv1411797094:83 , srv1520628473:83 , srv1612772733:83 , srv2042713814:83 , srv2108487921:83 , srv340780093:83 , srv447299406:83 , srv702081320:83 , srv1020531809:84 , srv124917067:84 , srv1744536123:84 , srv2010123297:84 , srv2046320679:84 , srv2065717756:84 , srv76339977:84 , srv799092814:84 , srv801703529:84 , srv1045165607:85 , srv1051717488:85 , srv1246977557:85 , srv1250947973:85 , srv1336526046:85 , srv1386536315:85 , srv1507142341:85 , srv1582400887:85 , srv1601155074:85 , srv1757310805:85 , srv204999414:85 , srv378372387:85 , srv427562319:85 , srv434436391:85 , srv586510797:85 , srv608736089:85 , srv665248313:85 , srv761723623:85 , srv1012098097:86 , srv1059497716:86 , srv1375455676:86 , srv1393571507:86 , srv1877483832:86 , srv1976163052:86 , srv2113352981:86 , srv218173195:86 , srv462606905:86 , srv483158683:86 , srv744782491:86 , srv848984681:86 , srv990699560:86 , srv1420937103:87 , srv1480354712:87 , srv1610303819:87 , srv1645704832:87 , srv1674394600:87 , srv1676227101:87 , srv1739423765:87 , srv1777459355:87 , srv1781465965:87 , srv1796451030:87 , srv190295969:87 , srv1924039244:87 , srv252269020:87 , srv326108775:87 , srv355180933:87 , srv475285707:87 , srv611246887:87 , srv688057869:87 , srv709669169:87 , srv712050951:87 , srv1116178609:88 , srv402363943:88 , srv632478565:88 , srv793674325:88 , srv995169008:88 , srv1488415132:89 , srv1618708538:89 , srv1729948081:89 , srv1921141244:89 , srv2121139121:89 , srv497411825:89 , srv654950965:89 , srv126080390:90 , srv1696449789:90 , srv408151396:90 , srv241917338:91 , srv672944364:93 , srv273761656:537 }
2023-09-17 20:54:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046320679=53, srv252269020=62, srv799092814=94, srv2065717756=55, srv1025181941=2, srv1976163052=50, srv1582400887=26, srv326108775=64, srv475285707=74, srv1059497716=7, srv340780093=65, srv632478565=81, srv1375455676=17, srv1420937103=21, srv1921141244=48, srv124917067=13, srv1012098097=0, srv1386536315=18, srv586510797=78, srv76339977=92, srv218173195=60, srv2113352981=57, srv1488415132=23, srv1739423765=38, srv848984681=97, srv1781465965=42, srv712050951=89, srv1744536123=39, srv402363943=68, srv1618708538=30, srv483158683=75, srv672944364=85, srv1480354712=22, srv462606905=73, srv665248313=84, srv1250947973=14, srv117370768=10, srv744782491=90, srv1393571507=19, srv1785716412=44, srv1676227101=35, srv190295969=47, srv1520628473=25, srv1729948081=37, srv1877483832=46, srv688057869=86, srv2136684406=59, srv1045165607=4, srv608736089=79, srv995169008=99, srv2042713814=52, srv990699560=98, srv793674325=93, srv1645704832=32, srv2121139121=58, srv1411797094=20, srv241917338=61, srv537758087=77, srv1610303819=28, srv408151396=69, srv659267486=83, srv115820099=9, srv1116178609=8, srv1336526046=16, srv1507142341=24, srv1696449789=36, srv447299406=72, srv1053638867=6, srv611246887=80, srv1200839115=11, srv378372387=67, srv1674394600=34, srv761723623=91, srv822547036=96, srv1025577262=3, srv1601155074=27, srv801703529=95, srv427562319=70, srv654950965=82, srv355180933=66, srv1783478905=43, srv1924039244=49, srv1777459355=41, srv1619906295=31, srv273761656=63, srv1796451030=45, srv1020531809=1, srv1757310805=40, srv709669169=88, srv204999414=54, srv497411825=76, srv1612772733=29, srv2108487921=56, srv1051717488=5, srv1661511847=33, srv126080390=15, srv1246977557=12, srv2010123297=51, srv434436391=71, srv702081320=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:19,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:19,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-17 20:54:19,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-17 20:54:19,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-17 20:54:19,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-17 20:54:19,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-17 20:54:19,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-17 20:54:19,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-17 20:54:19,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02418802351075378); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035216183403556194, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02418802351075378); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04708333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:19,290 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-17 20:54:19,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014942025360305896, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02418802351075378); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035216183403556194, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02418802351075378); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04708333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-17 20:54:19,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 241 ms to try 5000 different iterations.  Found a solution that moves 1029 regions; Going from a computed imbalance of 0.014942025360305896 to a new imbalance of 8.033117738195292E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008035648222105054); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00992678020345126); MoveCostFunction : (multiplier=7.0, imbalance=0.11433333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008035648222105054); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:19,456 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv241917338:81 , srv672944364:82 , srv822547036:82 , srv1045165607:83 , srv1053638867:83 , srv1116178609:83 , srv1696449789:83 , srv1777459355:83 , srv1785716412:83 , srv190295969:83 , srv402363943:83 , srv447299406:83 , srv1051717488:84 , srv126080390:84 , srv1676227101:84 , srv1729948081:84 , srv1781465965:84 , srv1924039244:84 , srv497411825:84 , srv611246887:84 , srv1012098097:85 , srv1025577262:85 , srv1059497716:85 , srv117370768:85 , srv124917067:85 , srv1336526046:85 , srv1420937103:85 , srv1507142341:85 , srv1601155074:85 , srv1610303819:85 , srv1612772733:85 , srv1645704832:85 , srv1661511847:85 , srv1744536123:85 , srv1757310805:85 , srv1783478905:85 , srv1796451030:85 , srv1921141244:85 , srv2010123297:85 , srv2042713814:85 , srv326108775:85 , srv378372387:85 , srv408151396:85 , srv462606905:85 , srv586510797:85 , srv709669169:85 , srv761723623:85 , srv793674325:85 , srv801703529:85 , srv848984681:85 , srv990699560:85 , srv995169008:85 , srv115820099:86 , srv1250947973:86 , srv1375455676:86 , srv1393571507:86 , srv1411797094:86 , srv1488415132:86 , srv1520628473:86 , srv1582400887:86 , srv1739423765:86 , srv1877483832:86 , srv2046320679:86 , srv218173195:86 , srv355180933:86 , srv475285707:86 , srv483158683:86 , srv654950965:86 , srv659267486:86 , srv712050951:86 , srv744782491:86 , srv76339977:86 , srv799092814:86 , srv1020531809:87 , srv1025181941:87 , srv1246977557:87 , srv1386536315:87 , srv1674394600:87 , srv2065717756:87 , srv2108487921:87 , srv2121139121:87 , srv252269020:87 , srv340780093:87 , srv427562319:87 , srv434436391:87 , srv537758087:87 , srv608736089:87 , srv632478565:87 , srv665248313:87 , srv688057869:87 , srv702081320:87 , srv1200839115:88 , srv1480354712:88 , srv1618708538:88 , srv1619906295:88 , srv1976163052:88 , srv204999414:88 , srv2113352981:88 , srv2136684406:88 , srv273761656:540 }
2023-09-17 20:54:19,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:19,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046320679=53, srv252269020=62, srv799092814=94, srv2065717756=55, srv1025181941=2, srv1976163052=50, srv1582400887=26, srv326108775=64, srv475285707=74, srv1059497716=7, srv340780093=65, srv632478565=81, srv1375455676=17, srv1420937103=21, srv1921141244=48, srv124917067=13, srv1012098097=0, srv1386536315=18, srv586510797=78, srv76339977=92, srv218173195=60, srv2113352981=57, srv1488415132=23, srv1739423765=38, srv848984681=97, srv1781465965=42, srv712050951=89, srv1744536123=39, srv402363943=68, srv1618708538=30, srv483158683=75, srv672944364=85, srv1480354712=22, srv462606905=73, srv665248313=84, srv1250947973=14, srv117370768=10, srv744782491=90, srv1393571507=19, srv1785716412=44, srv1676227101=35, srv190295969=47, srv1520628473=25, srv1729948081=37, srv1877483832=46, srv688057869=86, srv2136684406=59, srv1045165607=4, srv608736089=79, srv995169008=99, srv2042713814=52, srv990699560=98, srv793674325=93, srv1645704832=32, srv2121139121=58, srv1411797094=20, srv241917338=61, srv537758087=77, srv1610303819=28, srv408151396=69, srv659267486=83, srv115820099=9, srv1116178609=8, srv1336526046=16, srv1507142341=24, srv1696449789=36, srv447299406=72, srv1053638867=6, srv611246887=80, srv1200839115=11, srv378372387=67, srv1674394600=34, srv761723623=91, srv822547036=96, srv1025577262=3, srv1601155074=27, srv801703529=95, srv427562319=70, srv654950965=82, srv355180933=66, srv1783478905=43, srv1924039244=49, srv1777459355=41, srv1619906295=31, srv273761656=63, srv1796451030=45, srv1020531809=1, srv1757310805=40, srv709669169=88, srv204999414=54, srv497411825=76, srv1612772733=29, srv2108487921=56, srv1051717488=5, srv1661511847=33, srv126080390=15, srv1246977557=12, srv2010123297=51, srv434436391=71, srv702081320=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:19,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:19,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-17 20:54:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-17 20:54:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-17 20:54:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-17 20:54:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-17 20:54:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-17 20:54:19,578 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008035648222105054); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00992678020345126); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008035648222105054); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:19,578 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-17 20:54:19,578 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.96106561819445E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008035648222105054); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00992678020345126); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008035648222105054); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-17 20:54:19,804 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 320 ms to try 5000 different iterations.  Found a solution that moves 302 regions; Going from a computed imbalance of 7.96106561819445E-4 to a new imbalance of 3.7131394165924876E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.033555555555555554, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:19,805 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1696449789:82 , srv1976163052:82 , srv586510797:82 , srv1020531809:83 , srv117370768:83 , srv1729948081:83 , srv2121139121:83 , srv2136684406:83 , srv76339977:83 , srv1012098097:84 , srv1025577262:84 , srv1200839115:84 , srv1246977557:84 , srv1250947973:84 , srv1336526046:84 , srv1480354712:84 , srv1582400887:84 , srv1601155074:84 , srv1618708538:84 , srv1619906295:84 , srv1674394600:84 , srv1739423765:84 , srv190295969:84 , srv2065717756:84 , srv2108487921:84 , srv2113352981:84 , srv252269020:84 , srv326108775:84 , srv378372387:84 , srv608736089:84 , srv632478565:84 , srv665248313:84 , srv688057869:84 , srv702081320:84 , srv822547036:84 , srv990699560:84 , srv1025181941:85 , srv1045165607:85 , srv1053638867:85 , srv1116178609:85 , srv115820099:85 , srv124917067:85 , srv126080390:85 , srv1386536315:85 , srv1420937103:85 , srv1488415132:85 , srv1507142341:85 , srv1520628473:85 , srv1612772733:85 , srv1661511847:85 , srv1676227101:85 , srv1744536123:85 , srv1781465965:85 , srv1783478905:85 , srv1785716412:85 , srv1796451030:85 , srv1877483832:85 , srv1921141244:85 , srv1924039244:85 , srv2010123297:85 , srv2042713814:85 , srv204999414:85 , srv218173195:85 , srv241917338:85 , srv340780093:85 , srv355180933:85 , srv408151396:85 , srv434436391:85 , srv462606905:85 , srv654950965:85 , srv659267486:85 , srv709669169:85 , srv712050951:85 , srv744782491:85 , srv761723623:85 , srv793674325:85 , srv799092814:85 , srv801703529:85 , srv848984681:85 , srv1051717488:86 , srv1059497716:86 , srv1375455676:86 , srv1393571507:86 , srv1411797094:86 , srv1610303819:86 , srv1645704832:86 , srv1757310805:86 , srv1777459355:86 , srv2046320679:86 , srv402363943:86 , srv427562319:86 , srv447299406:86 , srv475285707:86 , srv483158683:86 , srv497411825:86 , srv537758087:86 , srv611246887:86 , srv672944364:86 , srv995169008:86 , srv273761656:613 }
2023-09-17 20:54:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:19,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046320679=53, srv252269020=62, srv799092814=94, srv2065717756=55, srv1025181941=2, srv1976163052=50, srv1582400887=26, srv326108775=64, srv475285707=74, srv1059497716=7, srv340780093=65, srv632478565=81, srv1375455676=17, srv1420937103=21, srv1921141244=48, srv124917067=13, srv1012098097=0, srv1386536315=18, srv586510797=78, srv76339977=92, srv218173195=60, srv2113352981=57, srv1488415132=23, srv1739423765=38, srv848984681=97, srv1781465965=42, srv712050951=89, srv1744536123=39, srv402363943=68, srv1618708538=30, srv483158683=75, srv672944364=85, srv1480354712=22, srv462606905=73, srv665248313=84, srv1250947973=14, srv117370768=10, srv744782491=90, srv1393571507=19, srv1785716412=44, srv1676227101=35, srv190295969=47, srv1520628473=25, srv1729948081=37, srv1877483832=46, srv688057869=86, srv2136684406=59, srv1045165607=4, srv608736089=79, srv995169008=99, srv2042713814=52, srv990699560=98, srv793674325=93, srv1645704832=32, srv2121139121=58, srv1411797094=20, srv241917338=61, srv537758087=77, srv1610303819=28, srv408151396=69, srv659267486=83, srv115820099=9, srv1116178609=8, srv1336526046=16, srv1507142341=24, srv1696449789=36, srv447299406=72, srv1053638867=6, srv611246887=80, srv1200839115=11, srv378372387=67, srv1674394600=34, srv761723623=91, srv822547036=96, srv1025577262=3, srv1601155074=27, srv801703529=95, srv427562319=70, srv654950965=82, srv355180933=66, srv1783478905=43, srv1924039244=49, srv1777459355=41, srv1619906295=31, srv273761656=63, srv1796451030=45, srv1020531809=1, srv1757310805=40, srv709669169=88, srv204999414=54, srv497411825=76, srv1612772733=29, srv2108487921=56, srv1051717488=5, srv1661511847=33, srv126080390=15, srv1246977557=12, srv2010123297=51, srv434436391=71, srv702081320=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:19,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-17 20:54:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-17 20:54:19,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-17 20:54:19,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-17 20:54:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-17 20:54:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-17 20:54:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-17 20:54:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-17 20:54:19,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:19,906 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-17 20:54:19,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.5016744968621295E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-17 20:54:20,049 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 218 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 3.5016744968621295E-5 to a new imbalance of 8.476830625449716E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:20,050 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1375455676:83 , srv1610303819:83 , srv1757310805:83 , srv1777459355:83 , srv204999414:83 , srv355180933:83 , srv427562319:83 , srv608736089:83 , srv659267486:83 , srv1012098097:84 , srv1020531809:84 , srv1025181941:84 , srv1045165607:84 , srv1051717488:84 , srv1053638867:84 , srv1059497716:84 , srv1116178609:84 , srv115820099:84 , srv117370768:84 , srv1200839115:84 , srv124917067:84 , srv1250947973:84 , srv126080390:84 , srv1336526046:84 , srv1386536315:84 , srv1393571507:84 , srv1411797094:84 , srv1420937103:84 , srv1480354712:84 , srv1488415132:84 , srv1507142341:84 , srv1520628473:84 , srv1582400887:84 , srv1601155074:84 , srv1612772733:84 , srv1618708538:84 , srv1619906295:84 , srv1645704832:84 , srv1661511847:84 , srv1674394600:84 , srv1676227101:84 , srv1696449789:84 , srv1739423765:84 , srv1781465965:84 , srv1783478905:84 , srv1785716412:84 , srv1796451030:84 , srv1877483832:84 , srv190295969:84 , srv1921141244:84 , srv1924039244:84 , srv1976163052:84 , srv2010123297:84 , srv2046320679:84 , srv2108487921:84 , srv2113352981:84 , srv2121139121:84 , srv2136684406:84 , srv218173195:84 , srv241917338:84 , srv252269020:84 , srv326108775:84 , srv340780093:84 , srv402363943:84 , srv408151396:84 , srv434436391:84 , srv447299406:84 , srv462606905:84 , srv475285707:84 , srv483158683:84 , srv497411825:84 , srv537758087:84 , srv586510797:84 , srv611246887:84 , srv632478565:84 , srv654950965:84 , srv665248313:84 , srv672944364:84 , srv688057869:84 , srv709669169:84 , srv712050951:84 , srv744782491:84 , srv761723623:84 , srv76339977:84 , srv793674325:84 , srv799092814:84 , srv822547036:84 , srv848984681:84 , srv990699560:84 , srv995169008:84 , srv1025577262:85 , srv1246977557:85 , srv1729948081:85 , srv1744536123:85 , srv2042713814:85 , srv2065717756:85 , srv378372387:85 , srv702081320:85 , srv801703529:85 , srv273761656:684 }
2023-09-17 20:54:20,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:20,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2046320679=53, srv252269020=62, srv799092814=94, srv2065717756=55, srv1025181941=2, srv1976163052=50, srv1582400887=26, srv326108775=64, srv475285707=74, srv1059497716=7, srv340780093=65, srv632478565=81, srv1375455676=17, srv1420937103=21, srv1921141244=48, srv124917067=13, srv1012098097=0, srv1386536315=18, srv586510797=78, srv76339977=92, srv218173195=60, srv2113352981=57, srv1488415132=23, srv1739423765=38, srv848984681=97, srv1781465965=42, srv712050951=89, srv1744536123=39, srv402363943=68, srv1618708538=30, srv483158683=75, srv672944364=85, srv1480354712=22, srv462606905=73, srv665248313=84, srv1250947973=14, srv117370768=10, srv744782491=90, srv1393571507=19, srv1785716412=44, srv1676227101=35, srv190295969=47, srv1520628473=25, srv1729948081=37, srv1877483832=46, srv688057869=86, srv2136684406=59, srv1045165607=4, srv608736089=79, srv995169008=99, srv2042713814=52, srv990699560=98, srv793674325=93, srv1645704832=32, srv2121139121=58, srv1411797094=20, srv241917338=61, srv537758087=77, srv1610303819=28, srv408151396=69, srv659267486=83, srv115820099=9, srv1116178609=8, srv1336526046=16, srv1507142341=24, srv1696449789=36, srv447299406=72, srv1053638867=6, srv611246887=80, srv1200839115=11, srv378372387=67, srv1674394600=34, srv761723623=91, srv822547036=96, srv1025577262=3, srv1601155074=27, srv801703529=95, srv427562319=70, srv654950965=82, srv355180933=66, srv1783478905=43, srv1924039244=49, srv1777459355=41, srv1619906295=31, srv273761656=63, srv1796451030=45, srv1020531809=1, srv1757310805=40, srv709669169=88, srv204999414=54, srv497411825=76, srv1612772733=29, srv2108487921=56, srv1051717488=5, srv1661511847=33, srv126080390=15, srv1246977557=12, srv2010123297=51, srv434436391=71, srv702081320=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:20,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-17 20:54:20,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-17 20:54:20,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-17 20:54:20,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-17 20:54:20,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-17 20:54:20,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-17 20:54:20,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.259763985991403E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:20,147 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1375455676:83 , srv1610303819:83 , srv1757310805:83 , srv1777459355:83 , srv204999414:83 , srv355180933:83 , srv427562319:83 , srv608736089:83 , srv659267486:83 , srv1012098097:84 , srv1020531809:84 , srv1025181941:84 , srv1045165607:84 , srv1051717488:84 , srv1053638867:84 , srv1059497716:84 , srv1116178609:84 , srv115820099:84 , srv117370768:84 , srv1200839115:84 , srv124917067:84 , srv1250947973:84 , srv126080390:84 , srv1336526046:84 , srv1386536315:84 , srv1393571507:84 , srv1411797094:84 , srv1420937103:84 , srv1480354712:84 , srv1488415132:84 , srv1507142341:84 , srv1520628473:84 , srv1582400887:84 , srv1601155074:84 , srv1612772733:84 , srv1618708538:84 , srv1619906295:84 , srv1645704832:84 , srv1661511847:84 , srv1674394600:84 , srv1676227101:84 , srv1696449789:84 , srv1739423765:84 , srv1781465965:84 , srv1783478905:84 , srv1785716412:84 , srv1796451030:84 , srv1877483832:84 , srv190295969:84 , srv1921141244:84 , srv1924039244:84 , srv1976163052:84 , srv2010123297:84 , srv2046320679:84 , srv2108487921:84 , srv2113352981:84 , srv2121139121:84 , srv2136684406:84 , srv218173195:84 , srv241917338:84 , srv252269020:84 , srv326108775:84 , srv340780093:84 , srv402363943:84 , srv408151396:84 , srv434436391:84 , srv447299406:84 , srv462606905:84 , srv475285707:84 , srv483158683:84 , srv497411825:84 , srv537758087:84 , srv586510797:84 , srv611246887:84 , srv632478565:84 , srv654950965:84 , srv665248313:84 , srv672944364:84 , srv688057869:84 , srv709669169:84 , srv712050951:84 , srv744782491:84 , srv761723623:84 , srv76339977:84 , srv793674325:84 , srv799092814:84 , srv822547036:84 , srv848984681:84 , srv990699560:84 , srv995169008:84 , srv1025577262:85 , srv1246977557:85 , srv1729948081:85 , srv1744536123:85 , srv2042713814:85 , srv2065717756:85 , srv378372387:85 , srv702081320:85 , srv801703529:85 , srv273761656:684 }
2023-09-17 20:54:20,171 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3004 (was 3485)
2023-09-17 20:54:20,177 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=167, AvailableMemoryMB=3004
2023-09-17 20:54:20,178 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-17 20:54:20,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-17 20:54:20,191 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1145312390:84 , srv1148403313:84 , srv1207354926:84 , srv1346592230:84 , srv1361200168:84 , srv1485385005:84 , srv1623412242:84 , srv1782431616:84 , srv1847829759:84 , srv1960060342:84 , srv1975954060:84 , srv1980566352:84 , srv1982740453:84 , srv1984596394:84 , srv2010996569:84 , srv20369073:84 , srv217235537:84 , srv26977899:84 , srv363476441:84 , srv410383543:84 , srv493066327:84 , srv536234627:84 , srv547726007:84 , srv583469237:84 , srv723816226:84 , srv761785098:84 , srv832624411:84 , srv836966507:84 , srv929255920:84 , srv1903218627:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-17 20:54:20,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:54:20,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583469237=24, srv929255920=29, srv1148403313=1, srv1903218627=9, srv536234627=22, srv1145312390=0, srv1207354926=2, srv363476441=19, srv1980566352=12, srv832624411=27, srv1346592230=3, srv1847829759=8, srv410383543=20, srv836966507=28, srv493066327=21, srv1782431616=7, srv217235537=17, srv2010996569=15, srv1485385005=5, srv1361200168=4, srv1623412242=6, srv1982740453=13, srv547726007=23, srv1960060342=10, srv1975954060=11, srv26977899=18, srv1984596394=14, srv20369073=16, srv761785098=26, srv723816226=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:54:20,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:54:20,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:54:20,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:54:20,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:54:20,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:54:20,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:54:20,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:54:20,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:54:20,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-17 20:54:20,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1073146590326608, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:54:20,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912531188250746, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1073146590326608, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-17 20:56:20,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9995235 different iterations.  Found a solution that moves 1835 regions; Going from a computed imbalance of 0.9912531188250746 to a new imbalance of 4.2829815420000605E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6796296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:56:20,219 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1145312390:90 , srv1148403313:90 , srv1207354926:90 , srv1346592230:90 , srv1361200168:90 , srv1485385005:90 , srv1623412242:90 , srv1782431616:90 , srv1847829759:90 , srv1903218627:90 , srv1960060342:90 , srv1975954060:90 , srv1980566352:90 , srv1982740453:90 , srv1984596394:90 , srv2010996569:90 , srv20369073:90 , srv217235537:90 , srv26977899:90 , srv363476441:90 , srv410383543:90 , srv493066327:90 , srv536234627:90 , srv547726007:90 , srv583469237:90 , srv723816226:90 , srv761785098:90 , srv832624411:90 , srv836966507:90 , srv929255920:90 }
2023-09-17 20:56:20,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-17 20:56:20,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583469237=24, srv929255920=29, srv1148403313=1, srv1903218627=9, srv536234627=22, srv1145312390=0, srv1207354926=2, srv363476441=19, srv1980566352=12, srv832624411=27, srv1346592230=3, srv1847829759=8, srv410383543=20, srv836966507=28, srv493066327=21, srv1782431616=7, srv217235537=17, srv2010996569=15, srv1485385005=5, srv1361200168=4, srv1623412242=6, srv1982740453=13, srv547726007=23, srv1960060342=10, srv1975954060=11, srv26977899=18, srv1984596394=14, srv20369073=16, srv761785098=26, srv723816226=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-17 20:56:20,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-17 20:56:20,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-17 20:56:20,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-17 20:56:20,238 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1145312390:90 , srv1148403313:90 , srv1207354926:90 , srv1346592230:90 , srv1361200168:90 , srv1485385005:90 , srv1623412242:90 , srv1782431616:90 , srv1847829759:90 , srv1903218627:90 , srv1960060342:90 , srv1975954060:90 , srv1980566352:90 , srv1982740453:90 , srv1984596394:90 , srv2010996569:90 , srv20369073:90 , srv217235537:90 , srv26977899:90 , srv363476441:90 , srv410383543:90 , srv493066327:90 , srv536234627:90 , srv547726007:90 , srv583469237:90 , srv723816226:90 , srv761785098:90 , srv832624411:90 , srv836966507:90 , srv929255920:90 }
2023-09-17 20:56:20,250 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=131 (was 187), ProcessCount=170 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2835 (was 3004)