2023-05-07 13:53:37,518 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-07 13:53:37,863 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-07 13:53:37,981 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-07 13:53:38,048 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-07 13:53:38,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-07 13:53:38,068 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=388, ProcessCount=175, AvailableMemoryMB=15394
2023-05-07 13:53:38,070 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-07 13:53:38,071 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-07 13:53:38,217 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1017517814:84 , srv1025960526:84 , srv1058992895:84 , srv1080257786:84 , srv1099553218:84 , srv115476311:84 , srv1159611592:84 , srv1172467689:84 , srv1188155974:84 , srv1190832266:84 , srv1217621312:84 , srv1222757785:84 , srv1226375933:84 , srv1233995075:84 , srv1299956739:84 , srv1301101993:84 , srv138317560:84 , srv1391376887:84 , srv1396942009:84 , srv1431907854:84 , srv1438938042:84 , srv1473363485:84 , srv1473612033:84 , srv1509591709:84 , srv1511613577:84 , srv1513315008:84 , srv155398864:84 , srv1559367194:84 , srv1577072242:84 , srv1612175605:84 , srv1616570289:84 , srv1644498641:84 , srv1661452380:84 , srv1666865353:84 , srv167739401:84 , srv1684879083:84 , srv1693660501:84 , srv1720589800:84 , srv1764905514:84 , srv176636511:84 , srv1781380399:84 , srv180551590:84 , srv1824434910:84 , srv1848476687:84 , srv1923242899:84 , srv1953185898:84 , srv1984944402:84 , srv2046245333:84 , srv2061861433:84 , srv2072271470:84 , srv2093139751:84 , srv23431862:84 , srv246746005:84 , srv33412028:84 , srv347233083:84 , srv348567673:84 , srv389963206:84 , srv403130606:84 , srv416998183:84 , srv430285578:84 , srv441856977:84 , srv445818955:84 , srv466387417:84 , srv491396742:84 , srv496391946:84 , srv504742821:84 , srv512425718:84 , srv534932476:84 , srv563437080:84 , srv574362828:84 , srv579523141:84 , srv581828377:84 , srv583754602:84 , srv600604670:84 , srv624881276:84 , srv658384339:84 , srv661530852:84 , srv66792601:84 , srv69237544:84 , srv695661749:84 , srv701702988:84 , srv742796286:84 , srv766248586:84 , srv773266249:84 , srv786157643:84 , srv799315232:84 , srv810755136:84 , srv831025503:84 , srv853035401:84 , srv864382293:84 , srv870739836:84 , srv872824655:84 , srv893461490:84 , srv91528359:84 , srv962526353:84 , srv972982023:84 , srv982469297:84 , srv987695412:84 , srv998348080:84 , srv1048506844:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-07 13:53:38,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:53:38,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv563437080=69, srv167739401=35, srv348567673=56, srv1058992895=3, srv1299956739=15, srv661530852=77, srv1473612033=23, srv581828377=72, srv2061861433=49, srv534932476=68, srv2046245333=48, srv512425718=67, srv583754602=73, srv870739836=91, srv1172467689=8, srv1217621312=11, srv1159611592=7, srv466387417=63, srv799315232=86, srv1438938042=21, srv1188155974=9, srv1509591709=24, srv1048506844=2, srv246746005=53, srv742796286=82, srv2072271470=50, srv1666865353=34, srv491396742=64, srv810755136=87, srv1431907854=20, srv1824434910=43, srv1017517814=0, srv766248586=83, srv701702988=81, srv773266249=84, srv1513315008=26, srv853035401=89, srv33412028=54, srv389963206=57, srv1693660501=37, srv962526353=95, srv430285578=60, srv579523141=71, srv872824655=92, srv403130606=58, srv864382293=90, srv91528359=94, srv1781380399=41, srv1720589800=38, srv1391376887=18, srv2093139751=51, srv600604670=74, srv176636511=40, srv831025503=88, srv1226375933=13, srv1644498641=32, srv138317560=17, srv445818955=62, srv658384339=76, srv1984944402=47, srv1233995075=14, srv1473363485=22, srv180551590=42, srv1764905514=39, srv347233083=55, srv1684879083=36, srv1025960526=1, srv1559367194=28, srv1099553218=5, srv1923242899=45, srv416998183=59, srv786157643=85, srv624881276=75, srv1222757785=12, srv574362828=70, srv1301101993=16, srv1511613577=25, srv496391946=65, srv982469297=97, srv1953185898=46, srv695661749=80, srv972982023=96, srv69237544=79, srv1190832266=10, srv1080257786=4, srv115476311=6, srv1396942009=19, srv1612175605=30, srv998348080=99, srv23431862=52, srv504742821=66, srv987695412=98, srv893461490=93, srv1577072242=29, srv155398864=27, srv1848476687=44, srv441856977=61, srv1616570289=31, srv1661452380=33, srv66792601=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:53:38,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:53:38,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:53:38,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:53:38,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:53:38,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:53:38,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:53:38,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-07 13:53:38,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-07 13:53:38,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-07 13:53:38,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-07 13:53:38,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-07 13:53:38,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-07 13:53:38,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-07 13:53:38,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-07 13:53:38,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-07 13:53:38,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-07 13:53:38,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-07 13:53:38,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-07 13:53:38,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-07 13:53:38,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-07 13:53:38,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-07 13:53:38,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-07 13:53:38,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-07 13:53:38,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-07 13:53:38,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-07 13:53:38,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-07 13:53:38,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-07 13:53:38,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-07 13:53:38,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:38,597 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-07 13:53:38,597 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-07 13:53:39,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1076 ms to try 5000 different iterations.  Found a solution that moves 4689 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18141426415500525. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03965872622017956, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05384226870210707, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.521, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03965872622017956, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:39,484 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1222757785:79 , srv1693660501:80 , srv2093139751:80 , srv1017517814:81 , srv893461490:81 , srv998348080:81 , srv1099553218:82 , srv1438938042:82 , srv23431862:82 , srv661530852:82 , srv1511613577:83 , srv167739401:83 , srv1684879083:83 , srv2061861433:83 , srv563437080:83 , srv579523141:83 , srv766248586:83 , srv1159611592:84 , srv1391376887:84 , srv1431907854:84 , srv1509591709:84 , srv180551590:84 , srv1923242899:84 , srv2072271470:84 , srv624881276:84 , srv853035401:84 , srv870739836:84 , srv1301101993:85 , srv155398864:85 , srv1559367194:85 , srv1616570289:85 , srv1824434910:85 , srv466387417:85 , srv581828377:85 , srv658384339:85 , srv972982023:85 , srv1025960526:86 , srv1080257786:86 , srv1226375933:86 , srv1396942009:86 , srv1666865353:86 , srv1720589800:86 , srv1848476687:86 , srv1984944402:86 , srv2046245333:86 , srv496391946:86 , srv534932476:86 , srv773266249:86 , srv872824655:86 , srv138317560:87 , srv1473612033:87 , srv33412028:87 , srv347233083:87 , srv389963206:87 , srv441856977:87 , srv491396742:87 , srv583754602:87 , srv600604670:87 , srv66792601:87 , srv69237544:87 , srv742796286:87 , srv831025503:87 , srv91528359:87 , srv1172467689:88 , srv1233995075:88 , srv1473363485:88 , srv1953185898:88 , srv348567673:88 , srv403130606:88 , srv416998183:88 , srv430285578:88 , srv445818955:88 , srv504742821:88 , srv786157643:88 , srv810755136:88 , srv982469297:88 , srv115476311:89 , srv1188155974:89 , srv1190832266:89 , srv1577072242:89 , srv1661452380:89 , srv1764905514:89 , srv1781380399:89 , srv574362828:89 , srv695661749:89 , srv1644498641:90 , srv176636511:90 , srv246746005:90 , srv864382293:90 , srv962526353:90 , srv1217621312:91 , srv1299956739:91 , srv1612175605:91 , srv799315232:91 , srv1513315008:92 , srv701702988:92 , srv987695412:92 , srv512425718:95 , srv1058992895:96 , srv1048506844:442 }
2023-05-07 13:53:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:53:39,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv563437080=69, srv167739401=35, srv348567673=56, srv1058992895=3, srv1299956739=15, srv661530852=77, srv1473612033=23, srv581828377=72, srv2061861433=49, srv534932476=68, srv2046245333=48, srv512425718=67, srv583754602=73, srv870739836=91, srv1172467689=8, srv1217621312=11, srv1159611592=7, srv466387417=63, srv799315232=86, srv1438938042=21, srv1188155974=9, srv1509591709=24, srv1048506844=2, srv246746005=53, srv742796286=82, srv2072271470=50, srv1666865353=34, srv491396742=64, srv810755136=87, srv1431907854=20, srv1824434910=43, srv1017517814=0, srv766248586=83, srv701702988=81, srv773266249=84, srv1513315008=26, srv853035401=89, srv33412028=54, srv389963206=57, srv1693660501=37, srv962526353=95, srv430285578=60, srv579523141=71, srv872824655=92, srv403130606=58, srv864382293=90, srv91528359=94, srv1781380399=41, srv1720589800=38, srv1391376887=18, srv2093139751=51, srv600604670=74, srv176636511=40, srv831025503=88, srv1226375933=13, srv1644498641=32, srv138317560=17, srv445818955=62, srv658384339=76, srv1984944402=47, srv1233995075=14, srv1473363485=22, srv180551590=42, srv1764905514=39, srv347233083=55, srv1684879083=36, srv1025960526=1, srv1559367194=28, srv1099553218=5, srv1923242899=45, srv416998183=59, srv786157643=85, srv624881276=75, srv1222757785=12, srv574362828=70, srv1301101993=16, srv1511613577=25, srv496391946=65, srv982469297=97, srv1953185898=46, srv695661749=80, srv972982023=96, srv69237544=79, srv1190832266=10, srv1080257786=4, srv115476311=6, srv1396942009=19, srv1612175605=30, srv998348080=99, srv23431862=52, srv504742821=66, srv987695412=98, srv893461490=93, srv1577072242=29, srv155398864=27, srv1848476687=44, srv441856977=61, srv1616570289=31, srv1661452380=33, srv66792601=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:53:39,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:53:39,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-07 13:53:39,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-07 13:53:39,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-07 13:53:39,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-07 13:53:39,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-07 13:53:39,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-07 13:53:39,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-07 13:53:39,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-07 13:53:39,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-07 13:53:39,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-07 13:53:39,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-07 13:53:39,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-07 13:53:39,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-07 13:53:39,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-07 13:53:39,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03965872622017956, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05384226870210707, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03965872622017956, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:39,687 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-07 13:53:39,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18138143107524976, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03965872622017956, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05384226870210707, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03965872622017956, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-07 13:53:40,023 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 461 ms to try 5000 different iterations.  Found a solution that moves 2614 regions; Going from a computed imbalance of 0.18138143107524976 to a new imbalance of 0.016836316917682823. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021597272970806592); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033079844229924875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29044444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021597272970806592); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:40,034 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1058992895:77 , srv512425718:78 , srv987695412:79 , srv1217621312:80 , srv1513315008:80 , srv962526353:80 , srv1299956739:81 , srv799315232:81 , srv115476311:82 , srv1233995075:82 , srv1612175605:82 , srv1644498641:82 , srv1661452380:82 , srv246746005:82 , srv416998183:82 , srv504742821:82 , srv574362828:82 , srv831025503:82 , srv1190832266:83 , srv1473363485:83 , srv176636511:83 , srv1781380399:83 , srv430285578:83 , srv695661749:83 , srv701702988:83 , srv786157643:83 , srv864382293:83 , srv982469297:83 , srv1172467689:84 , srv1577072242:84 , srv1616570289:84 , srv1764905514:84 , srv1953185898:84 , srv347233083:84 , srv496391946:84 , srv66792601:84 , srv742796286:84 , srv773266249:84 , srv872824655:84 , srv91528359:84 , srv1025960526:85 , srv1226375933:85 , srv1473612033:85 , srv33412028:85 , srv403130606:85 , srv441856977:85 , srv491396742:85 , srv583754602:85 , srv810755136:85 , srv1188155974:86 , srv1396942009:86 , srv1511613577:86 , srv1666865353:86 , srv348567673:86 , srv445818955:86 , srv600604670:86 , srv658384339:86 , srv972982023:86 , srv1080257786:87 , srv1301101993:87 , srv1509591709:87 , srv1559367194:87 , srv180551590:87 , srv1824434910:87 , srv389963206:87 , srv466387417:87 , srv534932476:87 , srv581828377:87 , srv624881276:87 , srv138317560:88 , srv155398864:88 , srv1720589800:88 , srv1848476687:88 , srv1923242899:88 , srv1984944402:88 , srv2046245333:88 , srv579523141:88 , srv69237544:88 , srv870739836:88 , srv1159611592:89 , srv1391376887:89 , srv1431907854:89 , srv167739401:89 , srv1684879083:89 , srv2061861433:89 , srv2072271470:89 , srv563437080:89 , srv853035401:89 , srv1099553218:90 , srv766248586:90 , srv998348080:90 , srv1017517814:91 , srv23431862:91 , srv661530852:91 , srv893461490:91 , srv1438938042:92 , srv1222757785:93 , srv1693660501:93 , srv2093139751:93 , srv1048506844:524 }
2023-05-07 13:53:40,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:53:40,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv563437080=69, srv167739401=35, srv348567673=56, srv1058992895=3, srv1299956739=15, srv661530852=77, srv1473612033=23, srv581828377=72, srv2061861433=49, srv534932476=68, srv2046245333=48, srv512425718=67, srv583754602=73, srv870739836=91, srv1172467689=8, srv1217621312=11, srv1159611592=7, srv466387417=63, srv799315232=86, srv1438938042=21, srv1188155974=9, srv1509591709=24, srv1048506844=2, srv246746005=53, srv742796286=82, srv2072271470=50, srv1666865353=34, srv491396742=64, srv810755136=87, srv1431907854=20, srv1824434910=43, srv1017517814=0, srv766248586=83, srv701702988=81, srv773266249=84, srv1513315008=26, srv853035401=89, srv33412028=54, srv389963206=57, srv1693660501=37, srv962526353=95, srv430285578=60, srv579523141=71, srv872824655=92, srv403130606=58, srv864382293=90, srv91528359=94, srv1781380399=41, srv1720589800=38, srv1391376887=18, srv2093139751=51, srv600604670=74, srv176636511=40, srv831025503=88, srv1226375933=13, srv1644498641=32, srv138317560=17, srv445818955=62, srv658384339=76, srv1984944402=47, srv1233995075=14, srv1473363485=22, srv180551590=42, srv1764905514=39, srv347233083=55, srv1684879083=36, srv1025960526=1, srv1559367194=28, srv1099553218=5, srv1923242899=45, srv416998183=59, srv786157643=85, srv624881276=75, srv1222757785=12, srv574362828=70, srv1301101993=16, srv1511613577=25, srv496391946=65, srv982469297=97, srv1953185898=46, srv695661749=80, srv972982023=96, srv69237544=79, srv1190832266=10, srv1080257786=4, srv115476311=6, srv1396942009=19, srv1612175605=30, srv998348080=99, srv23431862=52, srv504742821=66, srv987695412=98, srv893461490=93, srv1577072242=29, srv155398864=27, srv1848476687=44, srv441856977=61, srv1616570289=31, srv1661452380=33, srv66792601=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:53:40,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:53:40,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:53:40,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:53:40,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:53:40,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:53:40,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:53:40,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-07 13:53:40,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-07 13:53:40,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-07 13:53:40,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-07 13:53:40,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-07 13:53:40,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-07 13:53:40,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-07 13:53:40,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-07 13:53:40,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-07 13:53:40,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-07 13:53:40,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-07 13:53:40,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-07 13:53:40,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-07 13:53:40,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021597272970806592); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033079844229924875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021597272970806592); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:40,212 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-07 13:53:40,213 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016818013298471726, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021597272970806592); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033079844229924875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021597272970806592); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.014); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-07 13:53:40,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 413 ms to try 5000 different iterations.  Found a solution that moves 988 regions; Going from a computed imbalance of 0.016818013298471726 to a new imbalance of 6.991305744730395E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0050929751922394705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008328281296898499); MoveCostFunction : (multiplier=7.0, imbalance=0.10977777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0050929751922394705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:40,522 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1188155974:82 , srv138317560:82 , srv1438938042:83 , srv1984944402:83 , srv2046245333:83 , srv701702988:83 , srv1159611592:84 , srv1391376887:84 , srv1431907854:84 , srv155398864:84 , srv1612175605:84 , srv1720589800:84 , srv176636511:84 , srv1848476687:84 , srv2072271470:84 , srv23431862:84 , srv348567673:84 , srv389963206:84 , srv445818955:84 , srv534932476:84 , srv810755136:84 , srv853035401:84 , srv1017517814:85 , srv1058992895:85 , srv1222757785:85 , srv1473612033:85 , srv1513315008:85 , srv1577072242:85 , srv1693660501:85 , srv1764905514:85 , srv1781380399:85 , srv1923242899:85 , srv1953185898:85 , srv2061861433:85 , srv2093139751:85 , srv246746005:85 , srv33412028:85 , srv403130606:85 , srv491396742:85 , srv512425718:85 , srv600604670:85 , srv661530852:85 , srv69237544:85 , srv695661749:85 , srv766248586:85 , srv864382293:85 , srv893461490:85 , srv1025960526:86 , srv1080257786:86 , srv1099553218:86 , srv115476311:86 , srv1172467689:86 , srv1190832266:86 , srv1226375933:86 , srv1299956739:86 , srv1301101993:86 , srv1396942009:86 , srv1473363485:86 , srv1509591709:86 , srv1559367194:86 , srv1644498641:86 , srv1666865353:86 , srv167739401:86 , srv1684879083:86 , srv180551590:86 , srv1824434910:86 , srv347233083:86 , srv430285578:86 , srv441856977:86 , srv466387417:86 , srv563437080:86 , srv574362828:86 , srv579523141:86 , srv581828377:86 , srv583754602:86 , srv624881276:86 , srv66792601:86 , srv786157643:86 , srv799315232:86 , srv91528359:86 , srv987695412:86 , srv1217621312:87 , srv1661452380:87 , srv416998183:87 , srv496391946:87 , srv504742821:87 , srv658384339:87 , srv742796286:87 , srv870739836:87 , srv972982023:87 , srv982469297:87 , srv998348080:87 , srv1233995075:88 , srv1616570289:88 , srv773266249:88 , srv831025503:88 , srv872824655:88 , srv962526353:88 , srv1511613577:89 , srv1048506844:537 }
2023-05-07 13:53:40,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:53:40,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv563437080=69, srv167739401=35, srv348567673=56, srv1058992895=3, srv1299956739=15, srv661530852=77, srv1473612033=23, srv581828377=72, srv2061861433=49, srv534932476=68, srv2046245333=48, srv512425718=67, srv583754602=73, srv870739836=91, srv1172467689=8, srv1217621312=11, srv1159611592=7, srv466387417=63, srv799315232=86, srv1438938042=21, srv1188155974=9, srv1509591709=24, srv1048506844=2, srv246746005=53, srv742796286=82, srv2072271470=50, srv1666865353=34, srv491396742=64, srv810755136=87, srv1431907854=20, srv1824434910=43, srv1017517814=0, srv766248586=83, srv701702988=81, srv773266249=84, srv1513315008=26, srv853035401=89, srv33412028=54, srv389963206=57, srv1693660501=37, srv962526353=95, srv430285578=60, srv579523141=71, srv872824655=92, srv403130606=58, srv864382293=90, srv91528359=94, srv1781380399=41, srv1720589800=38, srv1391376887=18, srv2093139751=51, srv600604670=74, srv176636511=40, srv831025503=88, srv1226375933=13, srv1644498641=32, srv138317560=17, srv445818955=62, srv658384339=76, srv1984944402=47, srv1233995075=14, srv1473363485=22, srv180551590=42, srv1764905514=39, srv347233083=55, srv1684879083=36, srv1025960526=1, srv1559367194=28, srv1099553218=5, srv1923242899=45, srv416998183=59, srv786157643=85, srv624881276=75, srv1222757785=12, srv574362828=70, srv1301101993=16, srv1511613577=25, srv496391946=65, srv982469297=97, srv1953185898=46, srv695661749=80, srv972982023=96, srv69237544=79, srv1190832266=10, srv1080257786=4, srv115476311=6, srv1396942009=19, srv1612175605=30, srv998348080=99, srv23431862=52, srv504742821=66, srv987695412=98, srv893461490=93, srv1577072242=29, srv155398864=27, srv1848476687=44, srv441856977=61, srv1616570289=31, srv1661452380=33, srv66792601=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:53:40,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:53:40,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-07 13:53:40,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-07 13:53:40,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-07 13:53:40,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-07 13:53:40,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-07 13:53:40,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-07 13:53:40,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-07 13:53:40,670 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0050929751922394705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008328281296898499); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0050929751922394705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:40,670 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-07 13:53:40,670 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.922124506090133E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0050929751922394705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008328281296898499); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0050929751922394705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-07 13:53:41,058 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 495 ms to try 5000 different iterations.  Found a solution that moves 229 regions; Going from a computed imbalance of 6.922124506090133E-4 to a new imbalance of 1.496707674570591E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.025444444444444443, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:41,059 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1080257786:83 , srv69237544:83 , srv742796286:83 , srv870739836:83 , srv1058992895:84 , srv1099553218:84 , srv1172467689:84 , srv1190832266:84 , srv1217621312:84 , srv1222757785:84 , srv1233995075:84 , srv1299956739:84 , srv1301101993:84 , srv1391376887:84 , srv1396942009:84 , srv1511613577:84 , srv1513315008:84 , srv1559367194:84 , srv1612175605:84 , srv1644498641:84 , srv1666865353:84 , srv167739401:84 , srv1684879083:84 , srv1693660501:84 , srv1720589800:84 , srv1764905514:84 , srv176636511:84 , srv1824434910:84 , srv1848476687:84 , srv2093139751:84 , srv33412028:84 , srv348567673:84 , srv389963206:84 , srv403130606:84 , srv441856977:84 , srv445818955:84 , srv466387417:84 , srv512425718:84 , srv563437080:84 , srv581828377:84 , srv583754602:84 , srv600604670:84 , srv658384339:84 , srv661530852:84 , srv701702988:84 , srv773266249:84 , srv799315232:84 , srv864382293:84 , srv872824655:84 , srv91528359:84 , srv972982023:84 , srv982469297:84 , srv987695412:84 , srv998348080:84 , srv1017517814:85 , srv1025960526:85 , srv115476311:85 , srv1159611592:85 , srv1188155974:85 , srv1226375933:85 , srv138317560:85 , srv1431907854:85 , srv1438938042:85 , srv1473363485:85 , srv1473612033:85 , srv1509591709:85 , srv155398864:85 , srv1577072242:85 , srv1616570289:85 , srv1661452380:85 , srv1781380399:85 , srv180551590:85 , srv1953185898:85 , srv1984944402:85 , srv2046245333:85 , srv2061861433:85 , srv2072271470:85 , srv23431862:85 , srv246746005:85 , srv347233083:85 , srv416998183:85 , srv430285578:85 , srv491396742:85 , srv496391946:85 , srv504742821:85 , srv574362828:85 , srv624881276:85 , srv66792601:85 , srv695661749:85 , srv766248586:85 , srv786157643:85 , srv810755136:85 , srv831025503:85 , srv853035401:85 , srv893461490:85 , srv962526353:85 , srv1923242899:86 , srv534932476:86 , srv579523141:86 , srv1048506844:640 }
2023-05-07 13:53:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:53:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv563437080=69, srv167739401=35, srv348567673=56, srv1058992895=3, srv1299956739=15, srv661530852=77, srv1473612033=23, srv581828377=72, srv2061861433=49, srv534932476=68, srv2046245333=48, srv512425718=67, srv583754602=73, srv870739836=91, srv1172467689=8, srv1217621312=11, srv1159611592=7, srv466387417=63, srv799315232=86, srv1438938042=21, srv1188155974=9, srv1509591709=24, srv1048506844=2, srv246746005=53, srv742796286=82, srv2072271470=50, srv1666865353=34, srv491396742=64, srv810755136=87, srv1431907854=20, srv1824434910=43, srv1017517814=0, srv766248586=83, srv701702988=81, srv773266249=84, srv1513315008=26, srv853035401=89, srv33412028=54, srv389963206=57, srv1693660501=37, srv962526353=95, srv430285578=60, srv579523141=71, srv872824655=92, srv403130606=58, srv864382293=90, srv91528359=94, srv1781380399=41, srv1720589800=38, srv1391376887=18, srv2093139751=51, srv600604670=74, srv176636511=40, srv831025503=88, srv1226375933=13, srv1644498641=32, srv138317560=17, srv445818955=62, srv658384339=76, srv1984944402=47, srv1233995075=14, srv1473363485=22, srv180551590=42, srv1764905514=39, srv347233083=55, srv1684879083=36, srv1025960526=1, srv1559367194=28, srv1099553218=5, srv1923242899=45, srv416998183=59, srv786157643=85, srv624881276=75, srv1222757785=12, srv574362828=70, srv1301101993=16, srv1511613577=25, srv496391946=65, srv982469297=97, srv1953185898=46, srv695661749=80, srv972982023=96, srv69237544=79, srv1190832266=10, srv1080257786=4, srv115476311=6, srv1396942009=19, srv1612175605=30, srv998348080=99, srv23431862=52, srv504742821=66, srv987695412=98, srv893461490=93, srv1577072242=29, srv155398864=27, srv1848476687=44, srv441856977=61, srv1616570289=31, srv1661452380=33, srv66792601=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:53:41,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:53:41,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:53:41,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:53:41,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:53:41,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:53:41,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:53:41,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:53:41,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-07 13:53:41,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-07 13:53:41,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-07 13:53:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-07 13:53:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-07 13:53:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-07 13:53:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-07 13:53:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-07 13:53:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-07 13:53:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-07 13:53:41,226 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.3363584473578367E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:41,227 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1080257786:83 , srv69237544:83 , srv742796286:83 , srv870739836:83 , srv1058992895:84 , srv1099553218:84 , srv1172467689:84 , srv1190832266:84 , srv1217621312:84 , srv1222757785:84 , srv1233995075:84 , srv1299956739:84 , srv1301101993:84 , srv1391376887:84 , srv1396942009:84 , srv1511613577:84 , srv1513315008:84 , srv1559367194:84 , srv1612175605:84 , srv1644498641:84 , srv1666865353:84 , srv167739401:84 , srv1684879083:84 , srv1693660501:84 , srv1720589800:84 , srv1764905514:84 , srv176636511:84 , srv1824434910:84 , srv1848476687:84 , srv2093139751:84 , srv33412028:84 , srv348567673:84 , srv389963206:84 , srv403130606:84 , srv441856977:84 , srv445818955:84 , srv466387417:84 , srv512425718:84 , srv563437080:84 , srv581828377:84 , srv583754602:84 , srv600604670:84 , srv658384339:84 , srv661530852:84 , srv701702988:84 , srv773266249:84 , srv799315232:84 , srv864382293:84 , srv872824655:84 , srv91528359:84 , srv972982023:84 , srv982469297:84 , srv987695412:84 , srv998348080:84 , srv1017517814:85 , srv1025960526:85 , srv115476311:85 , srv1159611592:85 , srv1188155974:85 , srv1226375933:85 , srv138317560:85 , srv1431907854:85 , srv1438938042:85 , srv1473363485:85 , srv1473612033:85 , srv1509591709:85 , srv155398864:85 , srv1577072242:85 , srv1616570289:85 , srv1661452380:85 , srv1781380399:85 , srv180551590:85 , srv1953185898:85 , srv1984944402:85 , srv2046245333:85 , srv2061861433:85 , srv2072271470:85 , srv23431862:85 , srv246746005:85 , srv347233083:85 , srv416998183:85 , srv430285578:85 , srv491396742:85 , srv496391946:85 , srv504742821:85 , srv574362828:85 , srv624881276:85 , srv66792601:85 , srv695661749:85 , srv766248586:85 , srv786157643:85 , srv810755136:85 , srv831025503:85 , srv853035401:85 , srv893461490:85 , srv962526353:85 , srv1923242899:86 , srv534932476:86 , srv579523141:86 , srv1048506844:640 }
2023-05-07 13:53:41,267 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=453 (was 388) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=14543 (was 15394)
2023-05-07 13:53:41,281 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=453, ProcessCount=176, AvailableMemoryMB=14543
2023-05-07 13:53:41,282 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-07 13:53:41,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-07 13:53:41,300 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1147508779:84 , srv1379345487:84 , srv1388250123:84 , srv1825351882:84 , srv1871703449:84 , srv1883787668:84 , srv2056192780:84 , srv2056464246:84 , srv2103563393:84 , srv2145183588:84 , srv25371314:84 , srv25925538:84 , srv265584269:84 , srv282219219:84 , srv315433663:84 , srv432622672:84 , srv466137893:84 , srv551044219:84 , srv553209841:84 , srv609923303:84 , srv617443033:84 , srv634856195:84 , srv64791144:84 , srv76149935:84 , srv807862911:84 , srv840544415:84 , srv872585700:84 , srv874460847:84 , srv89977115:84 , srv1769203382:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-07 13:53:41,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:53:41,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466137893=17, srv2145183588=10, srv1871703449=5, srv1379345487=1, srv1883787668=6, srv807862911=25, srv1769203382=3, srv2056464246=8, srv551044219=18, srv315433663=15, srv265584269=13, srv1388250123=2, srv282219219=14, srv432622672=16, srv553209841=19, srv609923303=20, srv64791144=23, srv25371314=11, srv840544415=26, srv25925538=12, srv874460847=28, srv617443033=21, srv2056192780=7, srv872585700=27, srv89977115=29, srv1825351882=4, srv634856195=22, srv76149935=24, srv1147508779=0, srv2103563393=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:53:41,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:53:41,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:53:41,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-07 13:53:41,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0625093789282314, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:53:41,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912390008276165, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0625093789282314, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-07 13:55:41,328 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6936134 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912390008276165 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:55:41,336 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1147508779:90 , srv1379345487:90 , srv1388250123:90 , srv1769203382:90 , srv1825351882:90 , srv1871703449:90 , srv1883787668:90 , srv2056192780:90 , srv2056464246:90 , srv2103563393:90 , srv2145183588:90 , srv25371314:90 , srv25925538:90 , srv265584269:90 , srv282219219:90 , srv315433663:90 , srv432622672:90 , srv466137893:90 , srv551044219:90 , srv553209841:90 , srv609923303:90 , srv617443033:90 , srv634856195:90 , srv64791144:90 , srv76149935:90 , srv807862911:90 , srv840544415:90 , srv872585700:90 , srv874460847:90 , srv89977115:90 }
2023-05-07 13:55:41,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-07 13:55:41,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv466137893=17, srv2145183588=10, srv1871703449=5, srv1379345487=1, srv1883787668=6, srv807862911=25, srv1769203382=3, srv2056464246=8, srv551044219=18, srv315433663=15, srv265584269=13, srv1388250123=2, srv282219219=14, srv432622672=16, srv553209841=19, srv609923303=20, srv64791144=23, srv25371314=11, srv840544415=26, srv25925538=12, srv874460847=28, srv617443033=21, srv2056192780=7, srv872585700=27, srv89977115=29, srv1825351882=4, srv634856195=22, srv76149935=24, srv1147508779=0, srv2103563393=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-07 13:55:41,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-07 13:55:41,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-07 13:55:41,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-07 13:55:41,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-07 13:55:41,361 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1147508779:90 , srv1379345487:90 , srv1388250123:90 , srv1769203382:90 , srv1825351882:90 , srv1871703449:90 , srv1883787668:90 , srv2056192780:90 , srv2056464246:90 , srv2103563393:90 , srv2145183588:90 , srv25371314:90 , srv25925538:90 , srv265584269:90 , srv282219219:90 , srv315433663:90 , srv432622672:90 , srv466137893:90 , srv551044219:90 , srv553209841:90 , srv609923303:90 , srv617443033:90 , srv634856195:90 , srv64791144:90 , srv76149935:90 , srv807862911:90 , srv840544415:90 , srv872585700:90 , srv874460847:90 , srv89977115:90 }
2023-05-07 13:55:41,380 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 453), ProcessCount=171 (was 176), AvailableMemoryMB=14498 (was 14543)